Continental Autonomous Mobility US, LLC

Continental Automotive Systems Corporation

Gm Global Technolgoy Operations, Inc.

Xin Yu

Julien Ip

Matthew Donald Berkemeier

Eduardo Jose Ramirez Llanos

Kyle P Carpenter

Dhiren Verma

Danny Bynum

Eduardo Llanos

Andrew Phillip Bolduc

Fan Bai

John Sergakis

Joseph Zagroba

Wende Zhang

Lakshmi V Thanayankizil

David P Pop

Dominik Froehlich

Joyce Chiayu Chen

James Hockridge Critchley

William Benson Nichols

Francisco Alejandro Fuentes Perez

Victor Manuel Camacho Ruiz

Erick Daniel Rivera Gutierrez

Isemany Angelica Leal Martinez

Joyce Chen

A method and system are disclosed for estimating and using a trailer angle of a trailer relative to a vehicle connected to thereto. The method includes receiving image data from at least one first camera disposed on a vehicle and from at least one second camera disposed on a trailer coupled to the vehicle, and identifying matched point pairs by matching points in the image data from the at least one first camera with points in the image data from the at least one second camera, the points matched not being points of a representation of the vehicle or a representations of the trailer in the image data. The trailer angle of the trailer relative to the vehicle is estimated based upon the matched point pairs.

System and method for estimating relative trailer angle

A method for calibrating extrinsic parameters () of a trailer camera () supported by a trailer () attached to a tow vehicle (). The method includes determining a three-dimensional feature map () from one or more vehicle images () received from a camera () supported by the tow vehicle and identifying reference points () within the three-dimensional feature map. The method includes detecting the reference points within one or more trailer images received from the trailer camera after the vehicle and the trailer moved a predefined distance in the forward direction. The method also includes determining a trailer camera location () of the trailer camera () relative to the three-dimensional feature map () and determining a trailer reference point () based on the trailer camera location. The method also includes determining extrinsic parameters () of the trailer camera relative to the trailer reference point.

Automatic trailer camera calibration

A trailer assist system includes a controller configured to determine whether a trailer is in a jackknife condition based on an angle of the trailer relative to a vehicle. Determination is made whether the jackknife condition can be corrected by utilizing vehicle brakes, trailer brakes, or vehicle steering.

Trailer assist system with jackknife escape

A method of determining a tow hitch position. The method includes obtaining a two-dimensional image of a tow hitch in a three-dimensional scene. A model tow hitch is obtained in three dimensions. A three-dimensional rendering of a scene is generated that includes the model tow hitch. The model tow hitch in the three-dimensional rendering is positioned in an orientation corresponding with an orientation of the tow hitch in the three-dimensional scene.

Method for determining a tow hitch position

A vehicle driver assist system provides for the location of a target feature in an initial image and updates the location of that target feature based on information indicative of vehicle dynamic operation. The system predicts a relative position of the target feature within subsequent images such that only a portion of subsequent images need by analyzed and searched.

Visual tracking of target features

A method for autonomously parking a vehicle-trailer system is provided. The method includes receiving sensor system data from a sensor system supported by the vehicle. The sensor system data includes images of surroundings along a driving path of the vehicle-trailer system. The method includes determining a local map based on the sensor system data. The local map includes surroundings along the driving path. The method includes receiving a user selection of an image location within the images. The image location representing a position in the local map associated with a selected location within the surroundings. The method includes determining a parking path from a current location of the vehicle-trailer system to the position based on the local map and instructing a drive system to execute an autonomous parking behavior causing the vehicle-trailer system to autonomously drive along the parking path and autonomously park in the selected location.

Autonomous truck-trailer maneuvering and parking

A localization and mapping system and method for a motor vehicle is disclosed and includes at least one camera configured to obtain images of an environment surrounding the motor vehicle, at least one sensor configured to obtain location information for objects surrounding the motor vehicle and a controller configured to receive the images captured by the at least one camera and the location information obtained by the at least one sensor. The controller enhances the captured images utilizing a neural network and combines the enhanced images with the location information to localize the vehicle within the mapped environment.

Automotive localization and mapping in low-light environment

An automated parking system for a vehicle includes a camera configured to obtain images of objects proximate the vehicle, and a controller configured to review the obtained images of objects proximate the vehicle to classify an environment proximate the vehicle, determine a type of parking lot associated with the classified location and initiate an automated parking function of the vehicle corresponding to the determined type of parking lot.

Parking spot detection reinforced by scene classification

An automated vehicle parking system for a motor vehicle is disclosed and includes at least one camera obtaining images proximate a vehicle, at least one sensor array detecting objects proximate the vehicle, and a controller configured to generate a mask of an area proximate the vehicle from the images obtained by the at least one camera including labeled features identified within the obtained images and project the generated mask onto an occupancy grid generated with information from the at least one sensor array, wherein the controller is configured to locate a parking space responsive to open spaces defined within the generated mask.

Image semantic segmentation for parking space detection

A method determining an angle of a trailer relative to a vehicle. The method includes generating a projection on a trailer with a projector. An image is obtained of the projection on the trailer with a camera. An angle of the trailer relative to a vehicle is determined by comparing the image of the projection with a known pattern of the projection.

Method and device for detecting a trailer angle

A method for determining a position of a tow ball in an image. The method includes obtaining at least one real-time image from a vehicle. The at least one real-time image is processed with a controller on the vehicle to obtain a feature patch (f) describing at least one real-time image. A convolution is performed of the feature patch (f) and each filter (h) from a set of filters (H) with the filter (h) being based on data representative of known tow hitches fixed to the vehicle. A location of a tow ball on the tow hitch is identified in the at least one real-time image is based on the convolution between the feature patch (f) and each filter (h) from the set of filters (H).

Method for real-time tow ball detection

A method for autonomously maneuvering a vehicle in a rearward direction towards a point of interest is provided. The method includes receiving one or more images from a camera positioned on a back portion of the vehicle. The method includes overlaying a path on the one or more images. In addition, the method includes receiving a command by way of a user interface. The command includes instructions to adjust the path. The method includes adjusting the path based on the received command. The method also includes transmitting a drive command to a drive system supported by the vehicle. The drive command causes the vehicle to autonomously maneuver along the adjusted path in a rearward direction.

User-adjustable trajectories for automated vehicle reversing

A method for determining a distance between a camera positioned on a rear portion of a tow vehicle and a trailer coupler supported by a trailer positioned behind the tow vehicle as the tow vehicle approaches the trailer. The method includes identifying the trailer coupler of the trailer within one or more images of a rearward environment of the tow vehicle. The method also includes receiving sensor data from an inertial measurement unit supported by the tow vehicle. The method includes determining a pixel-wise intensity difference between a current received image from the one or more images and a previously received image from the one or more images. The method includes determining the distance based on the identified trailer coupler, the sensor data, and the pixel-wise intensity difference, the distance includes a longitudinal distance, a lateral distance, and a vertical distance.

Vehicle-trailer distance detection device and method

A method includes receiving one or more images from a camera positioned on a back portion of the vehicle and receiving a driver planned path from a user interface. The driver planned path includes a plurality of waypoints. The method also includes transmitting one or more commands to a drive system causing the vehicle to autonomously maneuver along the driver planned path. The method also includes determining a current vehicle position and an estimated subsequent vehicle position. The method also includes determining a path adjustment from the current vehicle position to the estimated subsequent vehicle position. The method also includes transmitting instructions to the drive system causing the vehicle to autonomously maneuver towards the estimated subsequent vehicle position based on the path adjustment.

Automated reversing by following user-selected trajectories and estimating vehicle motion

A method for autonomously maneuvering a tow vehicle towards a trailer positioned behind the tow vehicle is provided. The method includes receiving one or more images from one or more cameras positioned on a back portion of the tow vehicle. The method also includes identifying a trailer representation within the one or more images. The trailer representation being indicative of the trailer positioned behind the tow vehicle. The method also includes setting a vertical center of the trailer representation as a target. The method also includes determining a first steering wheel angle to turn the tow vehicle such that the vehicle autonomously maneuvers in a direction towards the target. The method also includes transmitting instructions to a drive system causing the tow vehicle to maneuver based on the first steering wheel angle.

Growing community of inventors

Troy, MI, United States of America

Xin Yu