Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Manoj Bikumandla

Andrew Matthew Bardagjy

Cina Hazegh

Chao Han

Fei Liu

John Enders Robertson

Scarlett Rodriguez

Bradley James Tallon

A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.

Systems and methods for facial expression tracking

The disclosed depth camera assembly may include a projector device to project light into an imaging environment. The projector device may include a light source and may also include a diffractive optical element that separates light emitted by the light source into a plurality of light regions including a plurality of separate wavelength ranges, such that each of the plurality of light regions contain light from only one of the plurality of separate wavelength ranges. The projector device may also include an interference filter. A head-mounted display system and related methods are also disclosed.

Systems and methods for a multi-spectral depth camera assembly

A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Stacked image sensor with polarization sensing pixel array

An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Systems and methods for optical demodulation in a depth-sensing device

An imaging system comprises two cameras and a processor. A first camera comprises a first grid of pixels configured to detect light in a broadband channel and a plurality of clusters of color filters sparsely arranged over the first grid of pixels. Each color filter passes light in a color channel to the grid of pixels. A second camera comprises a second grid of pixels configured to detect light in a broadband channel. The processor is configured to generate an aggregate image by combining a first image captured by the first camera and a second image captured by the second camera. The processor is also configured to add color values to the aggregate image based on color data captured by the first camera with the clusters of color filters. Additionally, the processor is configured to present the aggregate image with added color values on an electronic display.

Monochrome cameras with sparsely arranged clusters of color filters for coloration of content

An image sensor includes a two-dimensional array of active pixels, where each active pixel in the two-dimensional array of active pixels includes a respective photodiode. The image sensor also includes a plurality of lock-in pixels at two or more regions of the two-dimensional array. Each of the plurality of lock-in pixels includes two pixel elements that share a common photodiode. Each pixel element of the two pixel elements in a lock-in pixel includes a charge storage node and a switch configured to receive a respective control signal to selectively connect the respective charge storage node to the common photodiode.

Sparse lock-in pixels for high ambient controller tracking

An exemplary depth imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce different phase delays into a wavefront of the light, and a housing that secures the matrix between the optical sensor and the lens. The device further includes a communication bus coupled to a processing subsystem that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene. The device includes a positioning system that couples an optical component of the device to the housing. The optical component may include at least one of the lens, the optical sensor, or the matrix. Other related systems and methods are also provided.

Systems and methods for enhanced depth sensor devices

The disclosed imaging device may include an optical sensor, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of the light from the scene, and a housing that couples the matrix of variable-phase optical elements to the optical sensor. The housing may position the matrix at least substantially perpendicular to an optical axis of the optical sensor and may enable the optical sensor to capture at least two different perspectives of the scene per output image. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for enhanced optical sensor devices

An imaging device may include (1) an aperture, (2) a camera lens positioned to direct light received through the aperture to a plurality of image sensor elements at a front side of an image sensor array, and (3) the image sensor array. The plurality of image sensor elements may collect a portion of the light received through the aperture. A light-disrupting element may be disposed at a back side of the image sensor array. The light-disrupting element at the back side of the image sensor array may prevent at least a portion of the light that is not collected by the plurality of image sensor elements from reflecting back to the plurality of image sensor elements. Various other devices, systems, and methods are also disclosed.

Apparatuses, systems, and methods for disrupting light at a back-side of an image sensor array

An imaging device may include (1) an aperture, (2) a lens positioned to direct light received through the aperture to a front side of an image sensor; and (3) the image sensor. The image sensor may include (1) a light capture layer including a photosensitive material that is dimensioned such that (a) a first portion of the light having less than a predetermined wavelength is captured by the light capture layer, producing a current, and (b) a second portion of the light having at least the predetermined wavelength passes through the light capture layer, (2) a conduction pathway that conducts the produced current to a current sink, and (3) an image sensor layer that includes at least one image sensor element positioned to receive the second portion of the light that passes through the light capture layer. Various other devices, systems, and methods are also disclosed.

Apparatuses, systems, and methods for selectively suppressing ambient light in an image sensor

The disclosed system may include (1) a light source, (2) a first diffractive optical element (DOE), optically coupled with the light source, that produces a first diffracted light pattern, (3) at least one additional DOE, optically coupled with the light source in series with the first DOE, that produces at least one additional diffracted light pattern, (4) an actuator that moves, in response to a first actuator control signal, the first DOE in a first plane perpendicular to an optical axis of the system, and (5) a lens, optically coupled with the first DOE and the at least one additional DOE, that projects structured light onto a local area based on the first diffracted light pattern and the at least one additional diffracted light pattern. Various other systems and methods are also disclosed.

Systems and methods for a projector system with multiple diffractive optical elements

A system for a movable structured light projector may include (1) a light projector assembly that receives a light control signal and projects structured light into a local area based on the light control signal, (2) an imaging device that receives a capture control signal and captures a reflection of the structured light from the local area based on the capture control signal, and (3) an actuator, coupled to the light projector assembly, that receives an actuator control signal and moves the light projector assembly relative to the imaging device based on the actuator control signal. Various other systems and methods are also disclosed.

Growing community of inventors

Union City, CA, United States of America

Manoj Bikumandla