Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Andrew Matthew Bardagjy

Cina Hazegh

Fei Liu

Mark Timothy Sullivan

Simon Morris Shand Weiss

Joseph Duggan

Manoj Bikumandla

Likai Li

John Enders Robertson

Bradley James Tallon

Scarlett Rodriguez

The disclosed depth camera assembly may include a projector device to project light into an imaging environment. The projector device may include a light source and may also include a diffractive optical element that separates light emitted by the light source into a plurality of light regions including a plurality of separate wavelength ranges, such that each of the plurality of light regions contain light from only one of the plurality of separate wavelength ranges. The projector device may also include an interference filter. A head-mounted display system and related methods are also disclosed.

Systems and methods for a multi-spectral depth camera assembly

A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).

Camera assembly with programmable diffractive optical element for depth sensing

A sensor includes a first image pixel array including first image pixels and a second image pixel array including second image pixels. A polarization layer is disposed between the first image pixels and the second image pixels. Scene light incident upon the second image pixels propagates through the first image pixels and the polarization layer to reach the second image pixels.

Stacked image sensor with polarization sensing pixel array

A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).

Shifting diffractive optical element for adjustable depth sensing resolution

Coverglass is disposed over an image sensor. The coverglass includes a trench extending a depth into the coverglass. The trench is configured to receive a lens assembly and the lens assembly may be bonded to the trench.

Holder on glass imaging module

An exemplary imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of a light signal received from the scene through the lens, a housing that secures the matrix of variable-phase optical elements between the optical sensor and the lens, and a processing subsystem programmed to determine a phase difference associated with the light signal based on the at least two different phase delays. Related systems and methods are also provided.

Systems and methods for optical demodulation in a depth-sensing device

An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).

Imaging device based on lens assembly with embedded filter

An imaging system comprises two cameras and a processor. A first camera comprises a first grid of pixels configured to detect light in a broadband channel and a plurality of clusters of color filters sparsely arranged over the first grid of pixels. Each color filter passes light in a color channel to the grid of pixels. A second camera comprises a second grid of pixels configured to detect light in a broadband channel. The processor is configured to generate an aggregate image by combining a first image captured by the first camera and a second image captured by the second camera. The processor is also configured to add color values to the aggregate image based on color data captured by the first camera with the clusters of color filters. Additionally, the processor is configured to present the aggregate image with added color values on an electronic display.

Monochrome cameras with sparsely arranged clusters of color filters for coloration of content

A disclosed imaging device may include an image sensor, a lens system, and an aperture filter. The aperture filter may include a first concentric region that passes light of a first wavelength range and that blocks light of a second wavelength range and a second concentric region that passes light of the first wavelength range and light of the second wavelength range. The lens system may direct received light through the aperture filter toward the image sensor. The lens system and the aperture filter may provide a first depth-of-field associated with the first wavelength range and a second depth-of-field associated with the second wavelength range. Associated systems and methods are also disclosed.

Apparatuses, systems, and methods for high-sensitivity active illumination imaging

An image sensor includes a two-dimensional array of active pixels, where each active pixel in the two-dimensional array of active pixels includes a respective photodiode. The image sensor also includes a plurality of lock-in pixels at two or more regions of the two-dimensional array. Each of the plurality of lock-in pixels includes two pixel elements that share a common photodiode. Each pixel element of the two pixel elements in a lock-in pixel includes a charge storage node and a switch configured to receive a respective control signal to selectively connect the respective charge storage node to the common photodiode.

Sparse lock-in pixels for high ambient controller tracking

A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.

Tileable structured light projection system

An exemplary depth imaging device includes an optical sensor having an optical axis, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce different phase delays into a wavefront of the light, and a housing that secures the matrix between the optical sensor and the lens. The device further includes a communication bus coupled to a processing subsystem that directs the optical sensor to capture at least two different perspectives of the scene to create an output image indicating depth within the scene. The device includes a positioning system that couples an optical component of the device to the housing. The optical component may include at least one of the lens, the optical sensor, or the matrix. Other related systems and methods are also provided.

Systems and methods for enhanced depth sensor devices

The disclosed imaging device may include an optical sensor, a lens positioned to focus light from a scene onto the optical sensor, a matrix of variable-phase optical elements that are dimensioned to introduce at least two different phase delays into a wavefront of the light from the scene, and a housing that couples the matrix of variable-phase optical elements to the optical sensor. The housing may position the matrix at least substantially perpendicular to an optical axis of the optical sensor and may enable the optical sensor to capture at least two different perspectives of the scene per output image. Various other methods, systems, and computer-readable media are also disclosed.

Growing community of inventors

Fremont, CA, United States of America

Andrew Matthew Bardagjy