Gentex Corporation

Facebook, Inc.

Facebook Technologies, LLC

Guardian Optical Technologies, Ltd.

Dronomy Ltd.

Guy Raz

Nadav Grossinger

Yoav Zuta

Nitay Romano

Yuval Gronau

Yair Alpern

Emil Alon

Gideon Carmon

Roi Levy

Yotam Amiram

Vladimir Glazman

Yonatan Eadan

Gil Dotan

Ori Aphek

Robert Steel

Eran Dukas

Bar Mayo

Tal Recanati

Erab Dukas

A monitoring system for a vehicle includes at least one imaging device configured to capture a first image type and a second image type in a sequence. A first illumination source is configured to emit a flood illumination captured by the at least one imaging device in the first image type. A second illumination source is configured to emit an illumination pattern captured by the at least one imaging device in the second image type. At least one processor is configured to extract a 2-dimensional ('2D') skeletal representation of a vehicle occupant from the first image type, measure a depth of the 2D skeletal representation with the second image type, and extrapolate a 3-dimensional (“3D”) skeletal representation of the vehicle occupant.

3D skeleton detection for in-cabin automotive application

A monitoring system for a vehicle communicates with a user interface and includes a vision system that has a sensor configured to capture a presence of at least one vehicle occupant. A control system includes a processor configured to determine that the at least one vehicle occupant is attempting to interface with a user menu and determine a seating location of a first vehicle occupant attempting to interface with the user interface. The processor is further configured to categorize the first vehicle occupant attempting to interface with the user interface by the seating location and transmit an instruction to generate the user menu on the user interface specific to the categorization.

Monitoring system with dynamic user menu features

A system for monitoring an alertness level of an occupant of a vehicle includes a first sensor operable to detect an event exterior to the vehicle. A second imager is operable to capture an image of the occupant. A controller is in electrical communication with the first sensor and the second sensor. The controller is configured to determine a target direction aligning with a region of the event. The controller is further configured to determine a viewing direction of the occupant based on the image. The controller is further configured to compare the target direction to the viewing direction. The controller is further configured to determine the alertness level of the driver based on the comparison of the target direction to the viewing direction.

Systems and methods for eye gaze based alertness measurement

There is provided a system for generating instructions for adjustment of vehicle sub-system(s) according to an analysis of a computed six degrees of freedom (6 DOF) of vehicle occupant(s), comprising: hardware processor(s), and a non-transitory memory having stored thereon a code for execution by the at least one hardware processor, the code comprising instructions for: obtaining at least one image of a cabin of a vehicle captured by an image sensor, obtaining depth data from a depth sensor that senses the cabin of the vehicle, wherein the at least one image and the depth data depict at least one head of at least one occupant, computing 6 DOF for the at least one head according to the at least one image and depth data, and generating instructions for adjustment of at least one vehicle sub-system according to the computed 6 DOF of the at least one vehicle occupant.

Systems and methods for adjustment of vehicle sub-systems based on monitoring of vehicle occupant(s)

System and methods are provided for providing first responders after a vehicle accident with useful information regarding the medical status and injuries of the vehicle's occupants. The system includes an in-cabin sensor comprising at least one or more of an image sensor, depth sensor and micro-vibration sensor for capturing sensory data of the vehicle cabin including pre-crash data, during-crash and post-crash. The system also includes at least one processor configured to analyze the sensory data.

System, device, and method for vehicle post-crash support

A device for monitoring occupants of seats in a passenger compartment of a vehicle includes a plurality of structured light sources. Each of the plurality of structured light sources is attached to one of a plurality of sections and has an optical element that forms a structured light pattern. The plurality of structured light sources are oriented such that the plurality of structured light patterns, in combination, are directed such that they would cover the occupants of the seats of the vehicle. The plurality of structured light patterns, in combination, are directed such that they would cover all occupants of the seats. A camera is attached to a central niche and is configured to capture image patterns that result from distortion of the plurality of structured light patterns by the occupants of the seats.

Device for monitoring vehicle occupant(s)

A unified imaging device used for detecting and classifying objects in a scene including motion and micro-vibrations by receiving a plurality of images of the scene captured by an imaging sensor of the unified imaging device comprising a light source adapted to project on the scene a predefined structured light pattern constructed of a plurality of diffused light elements, classifying object(s) present in the scene by visually analyzing the image(s), extracting depth data of the object(s) by analyzing position of diffused light element(s) reflected from the object(s), identifying micro-vibration(s) of the object(s) by analyzing a change in a speckle pattern of the reflected diffused light element(s) in at least some consecutive images and outputting the classification, the depth data and data of the one or more micro-vibrations which are derived from the analyses of images captured by the imaging sensor and are hence inherently registered in a common coordinate system.

Visual, depth and micro-vibration data extraction using a unified imaging device

A device for monitoring occupants of seats in a passenger compartment of a vehicle comprises a heat sink divided into a plurality of sections. Each of the sections comprises a base and cooling fins. The bases extend along a common axis and define a central niche therebetween. Structured light sources are attached to the sections. The structured light sources have an optical element for forming a structured light pattern. The structured light sources are oriented along the common axis and at oblique angles to the central niche, such that the structured light patterns, in combination, are directed such that they would cover occupants of seats of the vehicle. A camera is attached to the niche and configured to capture image patterns resulting from distortion of the plurality of structured light patterns by the occupants of the seats.

A system and a method for producing an adjustable light pattern are provided herein. The system may include: a transmitter configured to illuminate a scene with a patterned light being adjusted based on predefined criteria; a receiver configured to receive reflections of the adjusted patterned light; and a computer processor configured to control the adjustment of the patterned light and further analyze the received reflections, to yield a depth map of objects within the scene, wherein the transmitter may include: a light source configured to produce a light beam; a first reflector tiltable approximately along a line on an x-y plane in a Cartesian x-y-z coordinate system; and a second reflector tiltable along a z-axis in said coordinate system, wherein the reflectors are tilted along their respective axes back and forth so as to divert the light beam for creating the adjusted patterned light.

Method and system for adjusting light pattern for structured light imaging

Apparatus for structured light scanning. The structured light includes one or more projected lines or other patterns. At least two independent emitters emit light for each projected line or pattern. Typically the at least two independent emitters are arranged in a row. The apparatus also includes a pattern generator for causing light from respective emitters of a given row to overlap along a pattern axis to form a projected pattern.

Structured light sensing for 3D sensing

A tracking system generates a structured light pattern in a local area. The system includes an array of lasers that generate light. The array of lasers includes a plurality of lasers and an optical element. The plurality of lasers are grouped into at least two subsets of lasers, and each of the at least two subsets of lasers is independently switchable. The optical element includes a plurality of cells that are each aligned with a respective subset of the array of lasers. Each cell receives light from a corresponding laser of the array of lasers, and each cell individually applies a modulation to the received light passing through the cell to form a corresponding portion of the structured light pattern that is projected onto a local area.

Growing community of inventors

Binyamina, Israel

Guy Raz