Gm Global Technolgoy Operations, Inc.

Brian Yousif-Dickow

Sai Vishnu Aluru

Tzvi Philipp

Steffen P Lindenthal

Andrew W Averhart

Sravan Daruri

Ali Atriss

Systems and methods for controlling a vehicle are provided. The systems and methods receive a frame of visible image data from at least one camera of the vehicle and a frame of invisible perception data from a perception sensor. The systems and methods fuse the frame of invisible perception data and the frame of visible image data to provide a fused frame of perception data. Object detection, classification and tracking are performed using a neural network based on the fused frame of perception data to provide object detection data. Steering, propulsion and/or braking of the vehicle are controlled based on the object detection data.

Methods and system for controlling a vehicle using fusion of multi_modality perception data

An optical sensor system operative for receiving, by a processor, a first image captured by a visible light camera, determining a value of a characteristic of the first image, determining an environmental condition in response to the value being less than a threshold, activating an infrared camera in response to the environmental condition, capturing a second image by the visible light camera and a third image by the infrared camera, generating a fused image in response to the second image and the third image, detecting an object in response to the fused image, and controlling a vehicle in response to the detection of the object.

Optical sensor activation and fusion

A windshield corrective optical system includes a motor vehicle having a windshield. A camera is positioned within an occupant compartment of the motor vehicle directed toward the windshield and receiving light rays passing through the windshield. A sensor is configured to receive the light rays. A corrective element is configured to allow passage of the light rays through the corrective element to the sensor. The corrective element corrects aberrations of the light rays induced by passing through the windshield prior to the light rays reaching the sensor.

Windshield corrective optic for forward facing cameras

Systems, methods, and apparatus are provided for real-time adjustment of image quality parameters. The system includes a controller configured to: acquire an image frame, having a fixed-pixel region that defines a region-of-interest, from one or more imaging devices; apply image processing techniques to determine a modified fixed-pixel region that excludes non-relevant object pixels; alter one or more image quality parameters based on statistics of pixels in the modified fixed-pixel region; and provide the altered one or more image quality parameters to the one or more imaging devices for use with subsequent image frames; wherein the one or more imaging devices produce an image that is tuned, based on the altered one or more image quality parameters, to the portions of the image in the region-of-interest that does not include the non-relevant object pixels.

Growing community of inventors

Farmington Hills, MI, United States of America

Brian Yousif-Dickow