Gm Global Technolgoy Operations, Inc.

Cadent, Inc.

Align Technology, Inc.

Stmicroelectronics Gmbh

Tzvi Philipp

Yossef Atiya

Noam Babayoff

Dan Levi

Thomas A Seder

Joseph F Szczerba

Igal Bilik

Shahar Villeval

Manoj Sharma

Michael Slutsky

Asaf Degani

Yael Shmueli Friedland

Igal Kotzer

Michael Baltaxe

Adam L Wright

Nathaniel W Hart

Emanuel Mordechai

Eran Kishon

Igai Bilik

Shuqing Zeng

Julien P Mourou

Yuri Paskover

Ron M Hecht

Ariel Telpaz

Jeremy A Salinger

Andrew W Averhart

Shai Silberstein

Brian Yousif-Dickow

Brenton John Sirowatka

Michelle M Clem

Timothy Busch

Tomer Pe'er

A system includes a neural network module, a lane keeping assist (LKA) module, and a control module. The neural network module is configured to receive driver data, identify the driver, receive non-driver data, and generate a lane assist offset value specific to the identified driver based on the non-driver data and the driver data. The LKA module is configured to receive the lane assist offset value, receive vehicle data associated with one or more parameters of the vehicle while the vehicle is moving, the one or more parameters including a steering angle, a velocity, and a vehicle position between lane markings, and generate a steering angle control signal based on the received lane assist offset value and vehicle data. The control module is configured to control steering of the vehicle based on the generated steering angle control signal. Other example systems and methods are also disclosed.

Adaptive driver lane keeping assist control

A system includes a projector module configured to project a visual media for a user, a user tracking sensor configured to sense whether the user is observing the visual media, and a control module configured to detect whether the user is looking at the projector module based on the user tracking sensor, in response to detecting the user is looking at the projector module, control the projector module to initiate projecting of the visual media for the user, detect an interruption of the user observing the visual media based on the user tracking sensor, and in response to detecting the interruption of the user observing the visual media, control the projector module to pause projecting of the visual media for the user. Other example systems and methods for controlling projection of a visual media for a user in a vehicle are also disclosed.

Feedback systems for optimized display operation

A detection system for a host vehicle includes a camera, global positioning system ('GPS') receiver, compass, and electronic control unit (“ECU”). The camera collects polarimetric image data forming an imaged drive scene inclusive of a road surface illuminated by the Sun. The GPS receiver outputs a present location of the vehicle as a date-and-time-stamped coordinate set. The compass provides a directional heading of the vehicle. The ECU determines the Sun's location relative to the vehicle and camera using an input data set, including the present location and directional heading. The ECU also detects a specular reflecting area or areas on the road surface using the polarimetric image data and Sun's location, with the specular reflecting area(s) forming an output data set. The ECU then executes a control action aboard the host vehicle in response to the output data set.

Automated detection of specular reflecting road surfaces using polarimetric image data

An automobile includes an electronic control unit (ECU), at least one fiber optical cable, and a sensor unit. The ECU is operational to generate an optical power signal and a first optical communications signal. The fiber optical cable transports the optical power signal and the first optical communications signal. The sensor unit is operational to convert the optical power signal into an electrical power, convert the first optical communications signal into an electrical control signal, measure a first parameter related to the automobile, and generate a second optical communications signal that conveys the first parameter as measured. The fiber optical transports the second optical communications signal to the electronic control unit. The ECU is further operational to convert the second optical communications signal into a first electrical sensed signal that conveys the first parameter, and take an action based on the first parameter in the first electrical sensed signal.

Intra-automobile power and communications via fiber

A system for a host vehicle operating on a road surface includes a polarimetric camera, a global positioning system ('GPS') receiver, a compass, and an electronic control unit (“ECU”). The camera collects polarimetric image data of a drive scene, including a potential driving path on the road surface. The ECU receives the polarimetric image data, estimates the Sun location using the GPS receiver and compass, and computes an ideal representation of the road surface using the Sun location. The ECU normalizes the polarimetric image data such that the road surface has a normalized representation in the drive scene, i.e., an angle of linear polarization (“AoLP”) and degree of linear polarization (“DoLP”) equal predetermined fixed values. The ECU executes a control action using the normalized representation.

Vehicle with polarimetric image normalization logic

A multiview campfire display includes a light source configured to emit a light beam and a spatial light modulator (SLM) positioned to receive the light beam emitted by the light source. The holographic display also includes a user tracker configured to track the head and eyes of the vehicle occupants. The display also includes a controller in communication with the user tracker, the light source, and the SLM. The controller is programmed to receive a eye-tracking signal from the user tracker and control a polarization optics of the light beam emitted by the light source and modulated by the SLM to reroute the image encoded by the SLM for the plurality of vehicle occupants based on the eye-tracking signal, thereby allowing each of the plurality of vehicle occupants to view the image.

Multiplexed floating autostereoscopic 3D display

A method of controlling a color display screen aboard a motor vehicle includes performing, via a host computer, a color calibration test of a user of the motor vehicle in which the user is subjected to a calibrated set of color-coded test information. The method includes receiving a color perception response of the user to the calibrated set of color-coded test information via the host computer. Additionally, the method includes mapping a reduced visual gamut of the user via the host computer using the color perception response, and then commanding adjustment of user-specific color settings of the motor vehicle using the reduced visual gamut to thereby accommodate a color perception deficiency of the user.

Vehicle display control for color-impaired viewers

A method for deblurring a blurred image includes dividing the blurred image into overlapping regions each having a size and an offset from neighboring overlapping regions along a first direction as determined by a period of a ringing artifact in the blurred image, or by obtained blur characteristics relating to the blurred image and/or attributable to the optical system, or by a detected cause capable of producing the blur characteristics, stacking the overlapping regions to produce a stacked output, wherein the overlapping regions are sequentially organized along the first direction, convolving the stacked output through a first convolutional neural network (CNN) to produce a first CNN output having reduced blur as compared to the stacked output, and assembling the first CNN output into a re-assembled image, and processing the re-assembled image through a second CNN to produce a deblurred image having reduced residual artifacts as compared to the re-assembled image.

Method and system for deblurring a blurred image

A visual perception system includes a scanning camera, color sensor with color filter array (CFA), and a classifier node. The camera captures full color pixel images of a target object, e.g., a traffic light, and processes the pixel images through a narrow band pass filter (BPF), such that the narrow BPF outputs monochromatic images of the target object. The color sensor and CFA receive the monochromatic images. The color sensor has at least three color channels each corresponding to different colors of spectral data in the monochromatic images. The classifier node uses a predetermined classification decision tree to classify constituent pixels of the monochromatic images into different color bins as a corresponding color of interest. The color of interest may be used to perform a control action, e.g., via an automated driver assist system (ADAS) control unit or an indicator device.

Generation of artificial color images from narrow spectral band data aboard a camera-equipped vehicle

A solid state steerable illumination system for a vehicle includes a first light source configured to generate light having a first wavelength, a first liquid crystal polarized grating (LCPG) device arranged to receive light from the first light source, and a vehicle control module configured to supply drive voltages to the first light source and the first LCPG device to generate a beam of light, wherein an output orientation angle of the beam of light is variable according to drive voltage applied to the first LCPG device.

Solid state steerable illumination system for vehicles

An optical arrangement includes at least one pair of displays, each pair having a first display and a second display configured to generate light in a visible spectral range. For each pair of displays, the optical arrangement includes a first polarizer configured to polarize the light incident from the first display, a second polarizer configured to polarize the light incident from the second display. The optical arrangement also includes first and second polarizing beam splitters for each pair of displays. Each polarizing beam splitter is configured to receive the polarized light from the first and second polarizers. Each polarizing beam splitter is also configured to reflect one of an s-polarized component and a p-polarized component of the received polarized light into at least one field of view (FOV) and transmit the other of the s-polarized component and the p-polarized component of the received polarized light into the subject FOV(s).

Polarization-based optical arrangement with virtual displays and multiple fields of view

A system and method of classifying an object. The system includes a polarizing beam splitter, a first detector, a second detector and a processor. The polarizing beam splitter generates a first source signal having a first polarization direction and a second source signal having a second polarization. The first detector transmits the first source signal at the object and receives a first reflected signal generated at the object in response to the first source signal. The second detector transmits the second source signal at the object and receives a second reflected signal generated at the object in response to the second source signal. The processor is configured to compare the first reflected signal to the second reflected signal to classify the object.

Polarization diversity detection in FMCW Lidar

A multi-directional viewing camera system for a motor vehicle including a vehicle body defining an interior compartment and a body panel having an exterior surface and an interior surface facing the interior compartment. The camera system includes a mirror module for mounting to the body panel exterior surface. The mirror module is configured to capture and transmit incident light from at least one field of view (FOV) and has a polarizing beam splitter configured to reflect an s-polarized component and transmit a p-polarized component of the incident light in a visible spectral range. The camera system also includes a camera module having a video camera for mounting to the body panel interior surface. The camera module is configured to receive from the mirror module the s-polarized or the p-polarized component of the incident light and selectively display at least one FOV within the interior compartment.

Multi-directional viewing camera system

A windshield corrective optical system includes a motor vehicle having a windshield. A camera is positioned within an occupant compartment of the motor vehicle directed toward the windshield and receiving light rays passing through the windshield. A sensor is configured to receive the light rays. A corrective element is configured to allow passage of the light rays through the corrective element to the sensor. The corrective element corrects aberrations of the light rays induced by passing through the windshield prior to the light rays reaching the sensor.

Windshield corrective optic for forward facing cameras

A perception system for a motor vehicle includes a camera with a lens having a field of view and configured to focus incident light from the field of view. The field of view includes a road having a road surface. The perception system also includes an imaging sensor arranged in the camera. The imaging sensor has a photosensitive surface defined by an imaging surface area configured to capture the incident light focused from the field of view. A first portion of the imaging surface area is configured to capture an image of the road. The perception system further includes a first polarizer array arranged across the first portion of the imaging surface area and configured to reduce glare from the road surface.

Growing community of inventors

Bet Shemesh, Israel

Tzvi Philipp