Invisage Technologies, Inc.

Apple Inc.

Invisage Inc.

Emanuele Mandelli

Edward Hartley Sargent

Jess Jan Young Lee

Jae Y Park

Nikolai E Bock

Zachary Michael Beiley

Aurelien Philippe Bouvier

Dario Clocchiatti

Hui Tian

Branko Petljanski

Gennady A Manokhin

Ricardo Jansson Motta

Noah Denis Bedard

Qiong Huang

Tom Sengelaub

Brett D Miller

Kathrin Berkner Cieslicki

Kenichi Saito

Martin Haller

Daniel R Hennigan

Edward Allen Valko

Ralph Beaudouin

Keenan Molner

Naveen Kolli

Lionel Barrymore Joseph Barrow

Xiaofeng Fan

Gennadiy A Agranov

Robert H Mullis

Xiangli Li

Andrew Kenneth John McMahon

David Michael Boisvert

Oray Orkun Cellek

Hua Gao

Francesco Cannillo

Gershon Rosenblum

Walter Nistico

Andras Pattantyus-Abraham

Bernhard Buettgen

Sai Harsha Jandhyala

Andras G Pattantyus-abraham

Gregory Chow

Nicola Galante

Andrei Nikiforov

Carey Tanner

Yuchuan Shao

Various implementations disclosed herein include devices, systems, and methods that obtain information from a first electronic device (e.g., to improve interactions for a CGR environment). In some implementations at a second electronic device having a processor, event camera data is obtained corresponding to modulated light (e.g., light including an information signal in its modulation) emitted by an optical source on the first electronic device and received at an event camera. The second electronic device is able to identify information from the first electronic device based on detecting a modulation pattern of the modulated light based on the event camera data. In some implementations, second electronic device is the same electronic device that has the event camera (e.g., laptop) or a different electronic device that receives the event data (e.g., a server receiving the event data from a laptop computer).

Method and system for encoded optical communication using a modulated light source

Various implementations disclosed herein include devices, systems, and methods that determine a control signal before synchronous readout of a frame (or part of the frame) is performed by a sensor. Various implementations disclosed herein include devices, systems, and methods that determine event density (e.g., a dense row signal or a dense frame signal) before synchronous readout is performed by the sensor. In some implementations, the event camera is capable of operating in a first readout mode and a second readout mode based on a number of events. In the second readout mode, less data per pixel may be readout.

Sensor data encoding with synchronous readout

A pulse-width modulation (PWM) image sensor is described herein. The PWM image sensor may have a stacked configuration. A top wafer of the PWM image sensor may have a charge-to-time converter and a logic wafer, stacked with the top wafer, may include a time-to-digital converter. The PWM image sensor may utilize variable transfer functions to avoid highlight compression and may utilize non-linear time quantization. A threshold voltage, as input to a charge-to-time converter, may additionally be controlled to affect light detection, dynamic range, and other features associated with the PWM image sensor.

Pulse-width modulation pixel sensor

A sensor stack is described. The sensor stack includes first and second electromagnetic radiation sensors. The first electromagnetic radiation sensor has a high quantum efficiency for converting a first range of electromagnetic radiation wavelengths into a first set of electrical signals. The second electromagnetic radiation sensor is positioned in a field of view of the first electromagnetic radiation sensor and has a high quantum efficiency for converting a second range of electromagnetic radiation wavelengths into a second set of electrical signals and a low quantum efficiency for converting the first range of electromagnetic radiation wavelengths into the second set of electrical signals. The first range of wavelengths does not overlap the second range of wavelengths, and the second electromagnetic radiation sensor is at least partially transmissive to the first range of electromagnetic radiation wavelengths.

Stacked electromagnetic radiation sensors for visible image sensing and infrared depth sensing, or for visible image sensing and infrared image sensing

Various implementations disclosed herein include devices, systems, and methods that buffer events in device memory during synchronous readout of a plurality of frames by a sensor. Various implementations disclosed herein include devices, systems, and methods that disable a sensor communication link until the buffered events are sufficient for transmission by the sensor. In some implementations, the sensor using a synchronous readout may select a readout mode for one or more frames based on how many of the pixels are detecting events. In some implementations, a first mode that reads out only data for a low percentage of pixels that have events uses the device memory and a second mode bypasses the device memory based on accumulation criteria such as high percentage of pixels detecting events. In the second mode, less data per pixel may be readout.

Sensor with low power synchronous readout

An image capture device may include an image sensor having a plurality of light-sensitive pixel sensors to capture light from a scene for generating images and a flicker detection circuit to detect flicker in the light captured by the image sensor. The flicker detection circuit may include one or more event-based readout circuits and at least one event-based processing circuit. The event-based readout circuits may detect a series of events associated with the flicker in the light captured by the image sensor. The event-based processing circuit may determine a frequency of the flicker in the captured light based on the series of events detected by the event-based readout circuits. In some embodiments, the frequency may be used to adjust the exposure time of the image sensor, e.g., to identify intervals for exposure when the captured light is bright.

Flicker detection using event-based readout circuits

In one implementation, an event sensor includes a plurality of pixels, an external readout line shared among the plurality of pixels, and an external processing circuit. Each pixel is configured to output pixel data indicative of an intensity of incident illumination. The external processing circuit is configured to output a stream of pixel events. Each respective pixel event is generated when a comparator of the external processing circuit obtains a sample of pixel data from a particular pixel via the external readout line that breaches a threshold value.

Pixel size reduction method for event driven sensors

A device for MR/VR systems that includes a two-dimensional array of cameras that capture images of respective portions of a scene. The cameras are positioned along a spherical surface so that the cameras have adjacent fields of view. The entrance pupils of the cameras are positioned at or near the user's eye while the cameras also form optimized images at the sensor. Methods for reducing the number of cameras in an array, as well as methods for reducing the number of pixels read from the array and processed by the pipeline, are also described.

Camera system

Methods and apparatus for using polarized light (e.g., infrared (IR) light) to improve eye-related functions such as iris recognition. An eye camera system includes one or more IR cameras that capture images of the user's eyes that are processed to perform iris recognition, gaze tracking, or other functions. At least one polarizing element may be located in the path of the light which is used to capture images of the user's eye. The user's eye may be illuminated by IR light emitted by one or more LEDs. At least one of the LEDs may be an LED with a polarizing filter. Instead or in addition, at least one polarizer may be located at the eye camera sensor, in the eye camera optics, or as or in an additional optical element located on the light path between the eye camera and the user's eye.

Eye camera systems with polarized light

In one implementation, an event sensor includes a plurality of pixels and an event compiler. The plurality of pixels are positioned to receive light from a scene disposed within a field of view of the event sensor. Each pixel is configured to have an operational state that is modified by control signals generated by a respective state circuit. The event compiler is configured to output a stream of pixel events. Each respective pixel event corresponds to a breach of a comparator threshold related to an intensity of incident illumination. Each control signal is generated based on feedback information that is received from an image pipeline configured to consume image data derived from the stream of pixel events.

Hardware implementation of sensor architecture with multiple power states

Methods and apparatus for fabricating light-emitting diodes (LEDs) that include polarizing or wavefront-altering optical components are described in which additional optical components are added to the LED package to filter or modify the polarization of the emitted photons. Packaged LEDs that include polarizing or wavefront-altering optical components are also described. The packaged LEDs may emit infrared light that is polarized or otherwise altered by the optical components added during the fabrication process.

Light-emitting diodes with optical filters

Imaging apparatus () includes a photosensitive medium () configured to convert incident photons into charge carriers. A bias electrode () overlies the photosensitive medium and applies a bias potential to the photosensitive medium. One or more pixel circuits () are formed on a semiconductor substrate. Each pixel circuit defines a respective pixel () and includes first and second pixel electrodes () coupled to collect the charge carriers from the photosensitive medium at respective first and second locations, and first and second transfer gates () in respective proximity to the first and second pixel electrodes. Circuitry () is coupled to apply different, respective first and second potentials to the first and second transfer gates and to vary the first and second potentials so as to control relative proportions of the charge carriers that are collected by the first and second electrodes.

Image sensor with phase-sensitive pixels

Various embodiments comprise apparatuses and methods including a light sensor. In one embodiment, an integrated circuit includes an image sensing array region, a first photosensor having a light-sensitive region outside of the image sensing array region, and control circuitry. The control circuitry is arranged in a first mode to read out image data from the image sensing array region, where the data provide information indicative of an image incident on the image sensing array region of the integrated circuit. The control circuitry is arranged in a second mode to read out a signal from the first photosensor indicative of intensity of light incident on the light-sensitive region of the first photosensor. Electrical power consumed by the integrated circuit during the second mode is at least ten times lower than electrical power consumed by the integrated circuit during the first mode. Additional methods and apparatuses are described.

Sensors and systems for the capture of scenes and events in space and time

Imaging apparatus () includes a semiconductor substrate (), which includes at least first and second sensing areas () with a predefined separation between the sensing areas. First and second arrays of pixel circuits () are formed respectively on the first and second sensing areas and define respective first and second matrices of pixels. First and second photosensitive films () are disposed respectively over the first and second arrays of pixel circuits, and are configured to output photocharge to the pixel circuits in response to radiation incident on the apparatus in different, respective first and second spectral bands.

Dual image sensors on a common substrate

Growing community of inventors

Mountain View, CA, United States of America

Emanuele Mandelli