Continental Autonomous Mobility Us, LLC

Continental Automotive Systems Corporation

Julien Ip

Xin Yu

Kyle P Carpenter

Eduardo Jose Ramirez Llanos

Matthew Donald Berkemeier

Dhiren Verma

Eduardo Llanos

Danny Bynum

Andrew Phillip Bolduc

Dominik Froehlich

Joseph Zagroba

Victor Manuel Camacho Ruiz

Ibro Muharemovic

Joyce Chiayu Chen

Dalong Li

William Benson Nichols

Steffen Hartmann

Lubna Khasawneh

Francisco Alejandro Fuentes Perez

Erick Daniel Rivera Gutierrez

Isemany Angelica Leal Martinez

Uriel Sanchez

Joyce Chen

A method for determining a trailer angle between a tow vehicle and a trailer attached to the tow vehicle includes receiving images from a camera positioned on a rear portion of the tow vehicle with a data processing hardware device, determining visual features from the images, tracking the visual features while the tow vehicle and trailer are moving and calculating, at the data processing hardware, the trailer angle based on the visual features. The trailer angle is then transmitted from the data processing hardware to one or more vehicle systems.

Vehicle trailer angle estimation via projective geometry

A method for visual trailer tracking of vehicle-trailer angle estimation, including: (a) camera receiving images, each most recently received image being identified as a current image, replacing a previously identified current image; (b) during a driving maneuver, extracting visual features from the current image, calculating a trailer angle from the current image, and storing the current image as a reference image, the trailer angle as a trailer angle reference and the extracted visual features as visual reference features; and (c) matching the visual features from the current image with the visual reference features. When a number of matches is below a threshold, repeating operation (c) to update the reference image, the trailer angle reference and the visual reference features. The method includes calculating a trailer angle between a trailer representation in the current image and a trailer representation in the reference image based in part upon the trailer angle reference.

Long-term visual trailer tracker for vehicle-trailer angle estimation

A method and system are disclosed for estimating and using a trailer angle of a trailer relative to a vehicle connected to thereto. The method includes receiving image data from at least one first camera disposed on a vehicle and from at least one second camera disposed on a trailer coupled to the vehicle, and identifying matched point pairs by matching points in the image data from the at least one first camera with points in the image data from the at least one second camera, the points matched not being points of a representation of the vehicle or a representations of the trailer in the image data. The trailer angle of the trailer relative to the vehicle is estimated based upon the matched point pairs.

System and method for estimating relative trailer angle

A method and system for locating and tracking a trailer coupler for autonomous vehicle operation is disclosed. The system converts an image from a vehicle camera to a depth map that includes a plurality of points indicative of a distance between an object within the image and a reference point. The system used the depth map to identify and track a coupler of a trailer.

Autonomous vehicle trailer hitch coupling system

A trailer assist system includes a controller configured to determine whether a trailer is in a jackknife condition based on an angle of the trailer relative to a vehicle. Determination is made whether the jackknife condition can be corrected by utilizing vehicle brakes, trailer brakes, or vehicle steering.

Trailer assist system with jackknife escape

A method for autonomously parking a vehicle-trailer system is provided. The method includes receiving sensor system data from a sensor system supported by the vehicle. The sensor system data includes images of surroundings along a driving path of the vehicle-trailer system. The method includes determining a local map based on the sensor system data. The local map includes surroundings along the driving path. The method includes receiving a user selection of an image location within the images. The image location representing a position in the local map associated with a selected location within the surroundings. The method includes determining a parking path from a current location of the vehicle-trailer system to the position based on the local map and instructing a drive system to execute an autonomous parking behavior causing the vehicle-trailer system to autonomously drive along the parking path and autonomously park in the selected location.

Autonomous truck-trailer maneuvering and parking

A localization and mapping system and method for a motor vehicle is disclosed and includes at least one camera configured to obtain images of an environment surrounding the motor vehicle, at least one sensor configured to obtain location information for objects surrounding the motor vehicle and a controller configured to receive the images captured by the at least one camera and the location information obtained by the at least one sensor. The controller enhances the captured images utilizing a neural network and combines the enhanced images with the location information to localize the vehicle within the mapped environment.

Automotive localization and mapping in low-light environment

An automated parking system for a vehicle includes a camera configured to obtain images of objects proximate the vehicle, and a controller configured to review the obtained images of objects proximate the vehicle to classify an environment proximate the vehicle, determine a type of parking lot associated with the classified location and initiate an automated parking function of the vehicle corresponding to the determined type of parking lot.

Parking spot detection reinforced by scene classification

An automated vehicle parking system for a motor vehicle is disclosed and includes at least one camera obtaining images proximate a vehicle, at least one sensor array detecting objects proximate the vehicle, and a controller configured to generate a mask of an area proximate the vehicle from the images obtained by the at least one camera including labeled features identified within the obtained images and project the generated mask onto an occupancy grid generated with information from the at least one sensor array, wherein the controller is configured to locate a parking space responsive to open spaces defined within the generated mask.

Image semantic segmentation for parking space detection

A method determining an angle of a trailer relative to a vehicle. The method includes generating a projection on a trailer with a projector. An image is obtained of the projection on the trailer with a camera. An angle of the trailer relative to a vehicle is determined by comparing the image of the projection with a known pattern of the projection.

Method and device for detecting a trailer angle

A method for autonomously maneuvering a vehicle in a rearward direction towards a point of interest is provided. The method includes receiving one or more images from a camera positioned on a back portion of the vehicle. The method includes overlaying a path on the one or more images. In addition, the method includes receiving a command by way of a user interface. The command includes instructions to adjust the path. The method includes adjusting the path based on the received command. The method also includes transmitting a drive command to a drive system supported by the vehicle. The drive command causes the vehicle to autonomously maneuver along the adjusted path in a rearward direction.

User-adjustable trajectories for automated vehicle reversing

A method includes receiving one or more images from a camera positioned on a back portion of the vehicle and receiving a driver planned path from a user interface. The driver planned path includes a plurality of waypoints. The method also includes transmitting one or more commands to a drive system causing the vehicle to autonomously maneuver along the driver planned path. The method also includes determining a current vehicle position and an estimated subsequent vehicle position. The method also includes determining a path adjustment from the current vehicle position to the estimated subsequent vehicle position. The method also includes transmitting instructions to the drive system causing the vehicle to autonomously maneuver towards the estimated subsequent vehicle position based on the path adjustment.

Automated reversing by following user-selected trajectories and estimating vehicle motion

A method for autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle is provided. The method includes receiving one or more images from one or more cameras positioned on a back portion of the tow vehicle. The method also includes identifying a trailer representation within the one or more images. The trailer representation being indicative of the trailer positioned behind the tow vehicle. The method also includes setting a vertical center of the trailer representation as a target. The method also includes determining a first steering wheel angle to turn the tow vehicle such that the vehicle autonomously maneuvers in a direction towards the target. The method also includes transmitting instructions to a drive system causing the tow vehicle to maneuver based on the first steering wheel angle.

Trailer detection and autonomous hitching

A method of detecting and localizing a coupler of a trailer hitch associated with a trailer positioned behind a tow vehicle is provided. The method includes determining a region of interest within images from a rear camera. The region of interest includes a representation of the trailer hitch. The method includes determining a three-dimensional (3D) point cloud representing objects inside the region of interest. The method includes determining a camera plane based on the images. The method includes projecting the cloud points onto the camera plane and determining a coupler location based on the projected cloud points onto the camera plane. The method includes determining a path based on the coupler location. The path ending when the tow vehicle is attached to the trailer. The method also includes sending instructions to a drive system causing the tow vehicle to autonomously drive in a rearward direction along the path.

Coupler and tow-bar detection for automated trailer hitching via cloud points

A method for autonomously maneuvering a tow vehicle. The method includes receiving images from one or more cameras positioned on a back portion of the tow vehicle and receiving sensor data from an inertial measurement unit supported by the tow vehicle. The method also includes determining a pixel-wise intensity difference between a current received image and a previous received image. The method includes determining a camera pose and a trailer pose with respect to a world coordinate system. The camera pose and the trailer pose are based on the images, the sensor data, and the pixel-wise intensity difference. The method includes determining a tow vehicle path based on the camera pose and the trailer pose. The method also includes instructing a drive system supported by the tow vehicle to autonomously maneuver along the tow vehicle path in a reverse direction causing the tow vehicle to hitch with the trailer.

Growing community of inventors

Madison Heights, MI, United States of America

Julien Ip