Magna Electronics Inc.

Other

Magna International Inc.

Smartsurv Vision Systems Gmbh

Benjamin May

Joern Ihlenburg

Boris Shulkin

Peter Nicke

Uwe May

Yuesheng Lu

Todd Deaville

Jasmin Jijina Sinkular

Umer Shahid

Sven Fleck

A vehicular driving assist system includes a plurality of lidar sensors having respective fields of sensing exterior the vehicle. The lidar sensors emit light pulsed at a respective pulse rate and provide a respective output to an electronic control unit based on sensed light that is reflected by objects present in the field of sensing of the respective lidar sensor. The pulse rates of light emitted by the lidar sensors are different. The vehicular driving assist system, via processing at the ECU of the outputs from the lidar sensors, generates a three dimensional (3D) point cloud. The vehicular driving assist system controls the vehicle based at least in part on light sensed by the lidar sensors that is reflected by the objects when light is emitted by the lidar sensors at the respective pulse rates.

Vehicular driving assist system with lidar sensors that emit light at different pulse rates

A method for calibrating a vehicular vision system includes disposing a camera at a vehicle, disposing a processor at the vehicle, and disposing a video display screen in the vehicle so as to be viewable by the vehicle driver. The video display screen is operable to display video images derived from image data captured by the imager of the camera. Image data is captured by the imager of the camera and provided to the processor. The video display screen displays video images derived from image data captured by the imager of the camera. The processor generates a graphic overlay for display with the video images at the video display screen. Responsive to processing captured image data, the vehicular vision system is calibrated by adapting an orientation and position of the image data relative to the generated graphic overlay to a corrected orientation and position relative to the generated graphic overlay.

Method for calibrating a vehicular vision system

A vehicular driving assist system includes a plurality of lidar sensors having respective fields of sensing exterior the vehicle, with the fields of sensing of first and second lidar sensors partially overlapping at an overlap region. The lidar sensors emit a respective pattern of light and provide a respective output to an ECU based on sensed light that is reflected by objects present in the field of sensing of the respective lidar sensor. The pattern of light emitted by the second lidar sensor differs from the pattern of light emitted by the first lidar sensor. The ECU determines misalignment of the second lidar sensor relative to the first lidar sensor based at least in part on the light sensed by each of the lidar sensors that is reflected by an object present in the overlap region when the respective pattern of light is emitted by the respective lidar sensor.

Vehicular driving assist system with lidar sensors that emit different patterns of light

A metasurface lens assembly to perform chromatic separation includes a first layer with a plurality of nanofins extending transversely there from and each being optically anisotropic and transmissive to light in the visible spectrum and having an optical characteristic that is set according to a phase profile. A second layer is spaced apart from the first layer and includes a plurality of photosensitive subpixels each associated with a different color. In operation, many beams of light may be directed onto the metasurface lens from a source with each beam of light having a plurality of component colors. The nanofins may function in combination with one another according to the phase profile to bend and focus the beams of light onto the second layer with each of the component colors being bent and focused differently to direct the component colors onto corresponding ones of the photosensitive subpixels.

Metasurface lens assembly for chromatic separation

A vision system of a vehicle includes a camera disposed at the vehicle and having a field of view exterior of the vehicle. The camera includes an imager and a processor that is operable to process image data captured by the imager. A video display screen is operable to display video images derived from image data captured by the camera. The processor generates a graphic overlay for display with the video images at the video display screen. The processor calibrates the graphic overlay by adapting the view orientation and position of the displayed video images utilizing a spatial transform engine to adapt the view orientation and position to a corrected position and orientation.

Vehicle vision system with overlay calibration

A lidar sensing system for a vehicle includes a plurality of lidar sensor modules disposed at a vehicle, with each lidar sensor module having a laser unit and a sensor unit, and with each lidar sensor module having a respective field of sensing exterior of the vehicle. Each field of sensing is different from the other fields of sensing and partially overlaps at least one other field of sensing. An output of each lidar sensor module is communicated to a control, and the control, responsive to outputs from the lidar sensor modules, determines a combined field of sensing.

Vehicle sensing system with calibration/fusion of point cloud partitions

A vision system for a vehicle includes first and second camera modules disposed at the vehicle so as to have respective first and second fields of view exterior of the vehicle. The first camera module includes a first lens and a first imager, and is operable to capture image data. The second camera module includes a second lens and a second imager, and is operable to capture image data. The first camera module is powered by a first power supply line and the second camera module is powered by a second power supply line. The first camera module includes an image processor operable to process image data captured by the first camera module and the second camera module. The second camera module comprises a second image processor operable to process image data captured by the first camera module and the second camera module.

Multi-camera vehicle vision system with distributed processing, data connection and power supply

A sensing system for a vehicle includes a control and a plurality of sensors disposed at the vehicle. The plurality of sensors includes individual sensors connected as a chain of sensors to a vehicle network. Outputs of the sensors are communicated to the control, which, responsive to the outputs of the sensors, determines presence of one or more objects exterior the vehicle and within a field of sensing of at least one of the sensors. Responsive to determination that a given sensor is the last sensor in the chain of sensors, the sensing system provides a termination configuration at that sensor.

Vehicle sensing system using chain of sensors

A vision system for a vehicle includes a camera having a camera processor operable to process image data captured by the camera. A central processor is disposed remote from the camera and is operable to process image data captured by the camera. The camera processor processes compressed image data and uncompressed image data and compares ROC curves for a given frame of image data to determine if the compression of that frame of image data has impact on processing of the image data. Responsive to determination that the compression of the frame has impact, the camera processor processes uncompressed data of that frame for a driver assist function and communicates a signal for the driver assist function. Responsive to determination that compression of the frame does not have impact, the vision system communicates compressed data of that frame for processing by the central processor for the driver assist function.

Vehicle vision system with adjustable computation and data compression

A method for testing the function of a driver assistance system of a vehicle, wherein an environment of the vehicle is detected by means of a sensor system, includes the following steps: stimulating the driver assistance system by means of an external stimulation; processing the stimulation in the driver assistance system so that a stimulation response is obtained; transmitting the stimulation and/or information relating to the stimulation to an external reference device and determining a reference response for the stimulation in the external reference device in accordance with a desired state of the driver assistance system; and comparing the stimulation response with the reference response. The invention enables the functionality of a driver assistance system of a vehicle to be tested in a simple and cost-effective manner.

Method for testing the function of a driver assistance system and control unit and reference device for a driver assistance system

A vision system for a vehicle includes a forward viewing camera disposed at a mirror head of an interior rearview mirror assembly of the vehicle and having a forward field of view through the windshield of the vehicle. A sensor is disposed at the mirror head and determines a change in position of the mirror head relative to a mirror mount of the mirror assembly when the vehicle driver adjusts the mirror head. A control includes a processor operable to process image data captured by the forward viewing camera. Responsive to determination by the sensor of a change of position of the forward viewing camera relative to the mirror mount, the control selects an active sub-array of photosensors to provide an effective field of view of the forward viewing camera. The processor processes image data captured by the active sub-array of photosensors for a driver assistance system of the vehicle.

Multi-sensor interior mirror device with image adjustment

A sensing system for a vehicle includes a plurality of sensors disposed at the vehicle. The plurality of sensors includes individual sensors connected to a vehicle network using a daisy chain topology. A control determines an address of the sensors and calibrates the sensors. The control, responsive to determination that an individual sensor is not the last sensor of a daisy chain of sensors, adjusts the internal electrical configuration to provide an open connection for another sensor. The control, responsive to determination that an individual sensor is the last sensor of the daisy chain of sensors, adjusts the internal electrical configuration to provide a termination configuration. The control, responsive to the outputs of the sensors, determines the presence of one or more objects exterior the vehicle and within the field of sensing of at least one of the sensors.

Vehicle sensing system using daisy chain of sensors

A vision system for a vehicle includes a camera having an image sensor and a lens, with the lens exposed to the environment exterior the vehicle. An image processor is operable to process multiple frames of image data captured by the camera and processes captured image data to detect a blob in a frame of captured image data. Responsive to processing a first frame of captured image data, and responsive to the image processor determining a first threshold likelihood that a detected blob is indicative of a contaminant, the image processor adjusts processing when processing subsequent frames of captured image data. Responsive to the image processor determining a second threshold likelihood that the detected blob is indicative of a contaminant when processing subsequent frames of captured image data, the image processor determines that the detected blob is representative of a contaminant at the lens of the camera.

Vehicle vision system with dirt detection

A vision system for a vehicle includes a camera disposed at a vehicle and having an image sensor and a lens. When the camera is disposed at the vehicle, the lens is exposed to the environment exterior the vehicle. The camera has an exterior field of view exterior the vehicle and is operable to capture image data representative of a scene occurring in the field of view of the camera. An image processor is operable to process multiple frames of image data captured by the camera, and wherein, responsive to processing multiple frames of captured image data, the image processor is operable to detect contaminants, such as water droplets or dirt, at the lens of the camera. Responsive to the image processor detecting contaminants at the lens of the camera, the vision system generates an alert and may trigger a function.

Growing community of inventors

Lübs, Germany

Benjamin May