Gm Global Technolgoy Operations, Inc.

Environmental Research Institute of Michigan

Jeremy A Salinger

Charles A Green

Shuqing Zeng

Omer Tsimhoni

James Nicholas Nickolaou

Bakhtiar Brian Litkouhi

Kevin Austin O'Dea

Eric L Raphael

Joel Pazhayampallil

Mark Edward Shields

Igal Bilik

Mohannad F Murad

William Joseph Chundrlik, Jr

Jin-Woo Lee

Shahar Villeval

Tzvi Philipp

Ron M Hecht

Claudia V Goldman-Shenhar

Akram M Abdel-Rahman

Asaf Degani

Michael Paul Turski

Michael D Alarcon

William G Herbert

Grant L Meade

Guy Raz

David M Zande

Kenneth L Rosol

Xingping Chen

Sigrid C Wagner

System and method of controlling operation of a device in real-time. The system includes an optical sensor having a steerable optical field of view for obtaining image data and a radar unit having a steerable radar field of view for obtaining radar data. A controller may be configured to steer a first one of the optical sensor and the radar unit to a first region of interest and a second one of the optical sensor and the radar unit to the second region of interest. The controller may be configured to steer both the optical sensor and the radar unit to the first region of interest. The radar data and the image data are fused to obtain a target location and a target velocity. The controller is configured to control operation of the device based in part on at least one of the target location and the target velocity.

System and method of controlling operation of a device with a steerable optical sensor and a steerable radar unit

Methods and systems for automatically controlling a vehicle are disclosed. In one embodiment, a system includes an actuator configured to control one or more vehicle driving characteristics, at least one vehicle sensor configured to measure a vehicle characteristic, a remote assistant in communication with the vehicle, and a controller in communication with the actuator, the at least one vehicle sensor, and the remote assistant, the controller being programmed with an automated driving system control algorithm and configured to determine whether a failsafe condition has occurred based on sensor data from the at least one vehicle sensor, receive a control signal from the remote assistant, and automatically control the actuator based on the control signal.

Methods and systems for remote parking assistance

Methods and systems for controlling a driving feature for an automated driving system are provided. In one embodiment, a method includes: receiving a first sensor signal from a first sensor; receiving a second sensor signal from a second sensor; selectively determining a driver intent based on at least one of the first sensor signal and the second sensor signal; and controlling the driving feature based on the driver intent.

Methods and systems for automated driving

A method for localizing a vehicle in a digital map. GPS raw measurement data is retrieved from satellites. A digital map of a region traveled by the vehicle based on the raw measurement data is retrieved from a database. The digital map includes a geographic mapping of a traveled road and registered roadside objects. The registered roadside objects are positionally identified in the digital map by earth-fixed coordinates. Roadside objects are sensed in the region traveled by the vehicle using distance data and bearing angle data. The sensed roadside objects are matched on the digital map. A vehicle position is determined on the traveled road by fusing raw measurement data and sensor measurements of the identified roadside objects. The position of the vehicle is represented as a function of linearizing raw measurement data and the sensor measurement data as derived by a Jacobian matrix and normalized measurements, respectively.

Sensor-aided vehicle positioning system

An automated vehicle includes a control system configured to selectively transfer the automated vehicle from an automated control mode to a manual control mode based on a transfer-of-control criterion. The transfer-of-control criterion is based on a current context of the automated vehicle and a dataset of previous transfer-of-control events and previous contexts associated with the operation of a plurality of additional automated vehicles.

Crowd-sourced transfer-of-control policy for automated vehicles

A vehicle lateral control system includes a lane marker module configured to determine a heading and displacement of a vehicle in response to images received from a secondary sensing device, a lane information fusion module configured to generate vehicle and lane information in response to data received from heterogeneous vehicle sensors and a lane controller configured to generate a collision free vehicle path in response to the vehicle and lane information from the lane information fusion module and an object map.

Redundant lane sensing systems for fault-tolerant vehicular lateral controller

A method and system for localizing a vehicle in a digital map includes generating GPS coordinates of the vehicle on the traveled road and retrieving from a database a digital map of a region traveled by the vehicle based on the location of the GPS coordinates. The digital map includes a geographic mapping of a traveled road and registered roadside objects. The registered roadside objects are positionally identified in the digital map by longitudinal and lateral coordinates. Roadside objects in the region traveled are sensed by the vehicle. The sensed roadside objects are identified on the digital map. A vehicle position on the traveled road is determined utilizing coordinates of the sensed roadside objects identified in the digital map. The position of the vehicle is localized in the road as a function of the GPS coordinates and the determined vehicle position utilizing the coordinates of the sensed roadside objects.

A method of detecting and tracking objects using multiple radar sensors. Objects relative to a host vehicle are detected from radar data generated by a sensing device. The radar data includes Doppler measurement data. Clusters are formed, by a processor, as a function of the radar data. Each cluster represents a respective object. Each respective object is classified, by the processor, as stationary or non-stationary based on the Doppler measurement data of each object and a vehicle speed of the host vehicle. Target tracking is applied, by the processor, on an object using Doppler measurement data over time in response to the object classified as a non-stationary object; otherwise, updating an occupancy grid in response to classifying the object as a stationary object.

Object fusion system of multiple radar imaging sensors

Methods and control systems are provided for automatically controlling operation of a vehicle. In one embodiment, the control system includes an exterior sensor for sensing the environment outside the vehicle. A processor is in communication with the exterior sensor and configured to calculate a driving plan of the vehicle based at least partially on the sensed environment outside the vehicle. The processor is also configured to calculate a confidence level of the driving plan of the vehicle based at least partially on the sensed environment around the vehicle. The control system also includes a display in communication with the processor and configured to receive data from the processor and display a representation of at least one of the driving plan and the confidence level.

Display systems and methods for autonomous vehicles

A method and system may manage the driver's attention while driving. The driver may be driving using an autonomous driving system or limited-ability autonomous driving system. A method may detect, by a sensor, characteristics of a driver; determine, based on the detected characteristics of the driver, whether the driver exercises sufficient supervisory control of the vehicle; and provide a series of one or more prompts, wherein each prompt's intrusiveness is related to the determination of whether the driver exercises sufficient supervisory control of the vehicle.

System and method for closed-loop driver attention management

A method and system may manage the driver's attention while driving. The driver may be driving using an autonomous driving system or limited-ability autonomous driving system. A steering wheel device may indicate to the driver a level of required supervisory control of a vehicle. The steering wheel device may include indicators to flash lights, vibrate, or provide other indicators. The indicators may have distinct levels of intensity for each level of supervisory control required to safely control a vehicle.

Steering wheel device for indicating required supervisory control of a vehicle and method for use

An augmented reality system includes a vision output device for displaying virtual images. A sensing device captures an image within a reference frame. The vision output device is captured within the image. A processing unit identifies the vision output device within the reference frame of the captured image and localizes the vision output device within the reference frame of the captured image for identifying an absolute position and orientation of the vision output device within the reference frame of the captured image. The vision output device generates virtual displays to a user at respective locations based on the absolute position and orientation of the vision output device within reference frame of the captured image. The sensing device captures a user's selection of a virtual control. The processing unit identifies the selection of the virtual control within the captured image and enables a control action of a controllable device.

System and apparatus for augmented reality display and controls

A method and system for driver attention management system may include means for closed-loop diagnostics. A convenience message may alert a driver of an item of interest to the driver. A sensor may detect the driver's response to the convenience message. Based on the response to the convenience message, the characteristics of an attentive response from the driver may be determined. The determined attentive response may be used by a driver attention management system. The driver attention management system may be able to diagnose errors in the sensors that are used in the driver attention management system. The driver attention management system may also be able to determine whether a driver is exercising sufficient supervisory control of a vehicle by determining whether the driver is attentively responding to prompts provided by the driver attention management system. The driver attention management system may be used in an autonomous or semi-autonomous driving system.

System and method for auto-correcting an autonomous driving system

A method to selectively prevent a vehicle from resuming a vehicle set speed stored in memory of a cruise control system includes monitoring a vehicle speed, determining that the vehicle speed indicates operation in a low speed range, determining a threshold slow zone maneuver based upon the vehicle speed substantially remaining in the low speed range through a predetermined duration, and inhibiting resumption of the vehicle set speed based upon the threshold slow zone maneuver.

Method for preventing activation of resume function in a cruise control system

A vehicle system for providing an interface for driver control of at least a partially autonomous vehicle. The system includes a driver command processor that receives request signals from a driver interface device of the driver's desire for the vehicle system to take certain actions and sends appropriate signals in response thereto to the proper autonomous vehicle systems. The driver command processor also sends signal to a display device indicating available actions, acknowledgement of the driver request, status of actions being taken or to be taken, etc.

Growing community of inventors

Southfield, MI, United States of America

Jeremy A Salinger