Gm Global Technolgoy Operations, Inc.

Manoj Sharma

Joseph F Szczerba

Thomas A Seder

Kai-Han Chang

John P Weiss

Donald K Grimm

Tzvi Philipp

Jacob Alan Bond

Michael A Losh

Akilesh Rajavenkatanarayanan

Robert C Jablonski

Pallavi Gautam

Aaron David Greer

A system for interpreting color includes a camera for capturing images of an environment and a controller in electrical communication with the camera. The controller is programmed to capture an image of the environment using the camera, where the image includes an object, retrieve a color calibration matrix from a non-transitory storage media of the controller, and determine a color of the object in the environment based at least in part on the color calibration matrix and the image of the environment.

Interpreting color in an environment

A graphics projector for use in a vehicle includes a light source module. The light source module may include an LED array configured to produce a source light. The light source module further includes an optical filter in optical communication with the led array. The optical filter is configured to receive the source light and transmit a filtered light. The light source module further includes a focusing lens in optical communication with the optical filter. The focusing lens is configured to receive the filtered light and transmit a narrow-beam light. The graphics projector also includes an optical collimator in optical communication with the light source module. The optical collimator is configured to receive the narrow-beam light and transmit a collimated light. The graphics projector also includes an optoelectrical mirror in optical communication with the optical collimator. The optoelectrical mirror is configured to direct the collimated light to form a graphic.

Graphics projector for use in a vehicle

A system for providing an alert to an occupant within a vehicle includes a system controller in communication with a plurality of onboard sensors, other vehicles and infrastructure systems, an augmented reality head up display system and a full windshield display system, each adapted to project images onto an inner surface of a windshield of the vehicle, the system controller adapted to detect at least one approaching vehicle, calculate a distance from the intersection, speed and trajectory of the at least one approaching vehicle, determine if the at least one approaching vehicle poses a threat and classify the at least one approaching vehicle as a threat vehicle, and provide a warning message and augmentation graphics by projecting the warning message and augmentation graphics onto the inner surface of the windshield with at least one of the AR-HUD system and the full windshield display system.

Risk informed route planner

A system for training a machine learning algorithm to generate a plurality of ideal hologram phase correction maps includes a holographic head-up display (HUD) configured to display a plurality of duplicates of a graphic based on a hologram phase map. The system further includes a camera system configured to view each of the plurality of duplicates of the graphic. The system further includes a controller in electrical communication with the holographic HUD and the camera system. The controller is programmed to determine a plurality of ground-truth hologram phase correction maps using a genetic algorithm, the holographic HUD, and the camera system. The controller is further programmed to generate a training dataset including a plurality of images of the graphic and train the machine learning algorithm to generate the plurality of ideal hologram phase correction maps.

Holographic display calibration

A system for facilitating interaction between an autonomous vehicle and an external interface in proximity to the autonomous vehicle including a plurality of external sensors positioned on the autonomous vehicle and adapted to collect data relative to an environment surrounding and in proximity to the autonomous vehicle, a controller having a wireless communication module, the wireless communication module adapted to facilitate wireless data exchange between the controller and remote entities, the controller adapted to receive data collected from the plurality of external sensors and identify an interaction mode for the external interface, a microphone and a speaker adapted to facilitate audible communication between the controller and the external interface, and a video display adapted to display visual information to the external interface, wherein the controller is adapted to perform an interaction with the external interface.

Autonomous vehicle interaction with physical environment

A system for providing information related to a charge status of an electric vehicle when the electric vehicle is connected to a charging station includes a system controller in communication with an electrical system within the electric vehicle and adapted to monitor information related to a charge status of the electric vehicle, and provide notification, to a third-party, of the charge status of the electric vehicle.

Method of providing information related to status of electric vehicle

A system includes a projector module configured to project a visual media for a user, a user tracking sensor configured to sense whether the user is observing the visual media, and a control module configured to detect whether the user is looking at the projector module based on the user tracking sensor, in response to detecting the user is looking at the projector module, control the projector module to initiate projecting of the visual media for the user, detect an interruption of the user observing the visual media based on the user tracking sensor, and in response to detecting the interruption of the user observing the visual media, control the projector module to pause projecting of the visual media for the user. Other example systems and methods for controlling projection of a visual media for a user in a vehicle are also disclosed.

Feedback systems for optimized display operation

A floodwater risk assessment system for a vehicle includes one or more cameras oriented to collect image data of floodwater located along a roadway the vehicle is traveling along, a time-of-flight sensor system that directs a laser beam towards a plurality of target points disposed along the floodwater one or more controllers in electronic communication with the one or more cameras and the time-of-flight sensor system. The one or more controllers execute instructions to determine a risk associated with crossing the floodwater at each of the plurality of target points located along the floodwater based on a flow speed of the floodwater and a floodwater depth. The one or more controllers generate a notification indicating the risk associated with crossing the floodwater at the plurality of target points located along the floodwater.

Floodwater risk assessment system for a vehicle

A system for identifying hidden bodies and providing augmentation within a head up display of a vehicle including at least one front camera adapted to collect images of an environment in front of the vehicle within and adjacent to a roadway on which the vehicle is traveling, an augmented reality head up display adapted to project an image upon an inner surface of a windshield of the vehicle, an augmented reality display adapted to project an image within the windshield, the controller adapted to use a trained neural network stored therein to map images captured by the at least one front camera to light field camera images stored within the trained neural network and to identify hidden bodies within the images captured by the at least one front camera, and display, within a windshield of the vehicle, augmentation graphics for the identified hidden bodies.

Machine learning based HUD system with alerts for hidden bodies

A display system for a vehicle includes a projection screen having an adjustable opacity, a projector for projecting an image on the projection screen, and a controller in electrical communication with the projector. The controller is programmed to adjust the opacity of the projection screen and direct the projector to project the image on the projection screen.

Reconfigurable display system

A system for generating a centrally located floating three-dimensional image display for a plurality of passengers positioned within a vehicle includes at least one display adapted to project a multiplexed image, a plurality of beam splitters, one beam splitter individually associated with each one of the plurality of passengers, and at least one passenger interface, each beam splitter adapted to receive a image from the at least one display and to reflect the image to the associated one of the plurality of passengers, wherein, each of the plurality of passengers perceives the image floating at a central location within the vehicle, the at least one passenger interface adapted to allow the plurality of passengers to receive annotated information and to provide input to the system.

Multi-perspective three-dimensional floating image display with touch function

A method for controlling the display of a vehicle includes receiving a video of a vehicle occupant inside the vehicle, detecting an action of the vehicle occupant of the vehicle using the video of the vehicle occupant inside the vehicle, and in response to detecting the action of the vehicle occupant, automatically adjusting a setting of the display of the vehicle based on the detected action of the vehicle occupant.

Automatic screen setting adjustment based on biological responses

A system for providing a projected security zone adjacent a vehicle includes an external projector in communication with a system controller and adapted to project a first graphic onto a surface adjacent the vehicle, the first graphic defining a pre-determined security zone, and a plurality of onboard sensors in communication with the system controller and adapted to detect the presence of an individual positioned within the projected security zone, the system controller adapted to provide a warning to the individual.

Projected security zone

A head-up display system includes a projector adapted to project an image, a primary reflector, and an exit pupil replicator, the primary reflector adapted to reflect an image projected by the projector to the exit pupil replicator, and the exit pupil replicator adapted to split the projected image into a two-dimensional array of identical projected images having equal intensity.

Reflective exit pupil replicator for HUD system

A system for controlling a brightness of a graphics projector for a vehicle includes a vehicle sensor, the graphics projector including at least one light source module, and a controller in electrical communication with the vehicle sensor and the graphics projector. The controller is programmed to determine an ambient light level using the vehicle sensor. The controller is further programmed to determine a projector brightness offset value based at least in part on the ambient light level. The controller is further programmed to project a graphic using the graphics projector based at least in part on the projector brightness offset value.

Growing community of inventors

Troy, MI, United States of America

Manoj Sharma