Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Oculus, Vr, LLC

Other

Meta Platforms, Inc.

Nicholas Daniel Trail

Douglas Robert Lanman

Robert Dale Cavin

Zhaoming Zhu

Yusufu Njoni Bamaxam Sulai

Richard Andrew Newcombe

Scott Charles McEldowney

Renzo De Nardi

Stephen James McNally

Pasi Saarikko

Andrew John Ouderkirk

Robin Sharma

James Ronald Bonar

Gareth John Valentine

Austin Wilson

Xinqiao Liu

Hee Yoon Lee

Byron Taylor

Sharvil Shailesh Talati

Michael Anthony Hall

Wai Sze Tiffany Lam

Behnam Bastani

Alexander Jobe Fix

Jason Victor Tsai

Kyle Justin Curts

Evan Gander

David Maurice Moore

Jacques Gollier

Lu Lu

Brian M Wheelwright

Qi Qu

Andrew Samuel Berkovich

Gang Lu

William Louis Abbott

Song Chen

Dong Zheng

Kevin James MacKenzie

Marina Zannoli

Fengqiang Li

Zihe Gao

Shuochen Su

Huixuan Tang

Michael Patrick Schaub

William Aaron Nicholls

Tamer Elazhary

Ji Luo

Ying Geng

Wanli Chi

Barry David Silverstein

Weichuan Gao

Nathan Seigo Matsuda

James Small

Yang Zhao

Vincent Brennan

Stephen Warren Gorton

William Anthony Wall

Hagar Edelstain

Julian Iseringhausen

Yufeng Zhu

A depth camera assembly (DCA) optimizes illumination and image capture of a local area to generate depth information of the local area. The DCA determines depth information for a first portion of the local area viewable at a first pose. The DCA is moved from the first pose to a second pose, where a second portion of the local area is viewable and overlaps with the first portion. The overlapping region is not illuminated by the DCA. A non-overlapping portion of the second portion is illuminated, captured, and depth information determined.

Dynamic illumination control for depth determination

A near-eye display (NED) includes a source assembly, a waveguide outside a field-of-view of a user, and a main optic within the field-of-view. The waveguide expands light emitted from the source assembly in at least one dimension and out-couple the expanded light. The main optic is partially transparent and is positioned such that the user of the NED looks through the main optic to view a local area surrounding the NED. The main optic receives light from the local area, combines the received light with the expanded light to generate combined light, and directs the combined light to the user's eye-box.

Expanding field-of-view in direct projection augmented reality and virtual reality systems

A retinal imaging system includes a projector, an imaging device, and a controller coupled to an eye tracking system under test. The projector emits a light pattern to be delivered to a pupil of an eye, a location of the pupil being estimated by the eye tracking system under test. The imaging device captures one or more images of a retina of the eye illuminated with at least a portion of the light pattern. The controller determines one or more eye tracking parameters based on the captured one or more images of the retina. The controller compares each determined eye tracking parameter with each of estimated one or more eye tracking parameters, wherein values for the one or more eye tracking parameters are estimated by the eye tracking system under test. The controller characterizes each estimated eye tracking parameter based on the comparison.

Full field retinal imaging system for characterization of eye trackers

A head-mounted-display includes an electronic display emitting image light and a varifocal block receiving the image light and outputting the image light in at least one of the focal planes of the varifocal block. The varifocal block includes a back optical element, a front optical element, and an actuator assembly coupled to the back and front optical element. The front optical element is positioned closer to an exit pupil than the back optical element, and separated from the back optical element by an adjustable distance, the magnitude of which determines in which of the focal planes the image light is presented. The actuator assembly simultaneously adjusts positions of the back optical element and the front optical element to vary the adjustable distance between the back optical element and the front optical element in accordance with an estimated vergence depth of the user.

Varifocal display with actuated reflectors

In one example, an apparatus comprises: multiple distinct sets of photodiodes, wherein each set of photodiodes includes one or more photodiodes, one or more charge sensing units, and a controller. The controller is configured to: transfer charge generated by the one or more photodiodes in response to a different component of incident light to the one or more charge sensing units in order to convert the charge to voltages; perform one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges, wherein the one or more quantization processes quantizes the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the at least some of the digital values.

Pixel sensor having multiple photodiodes

A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.

Correcting artifacts in tiled display assemblies for artificial reality headsets

A depth camera assembly for depth sensing of a local area includes an illumination source, an imaging device, and a controller. The illumination source illuminates a local area with light emitted in accordance with emission instructions generated by the controller. The illumination source includes an array of optical sources and an optical assembly. Operation of each optical source in the array is controllable based in part on the emission instructions. The optical assembly is configured to project the light into the local area. The imaging device captures one or more images of at least a portion of the light reflected from one or more objects in the local area. The controller determines depth information for the one or more objects based in part on the captured one or more images.

Depth camera assembly based on near infra-red illuminator

Disclosed herein are related to a system and a method of remotely rendering artificial reality. In one approach, a console determines an expected transmission end time of a first session for wireless transmission of image data indicating an image of artificial reality to a head wearable display. In one approach, the console determines an expected process end time of generating additional data associated with the image of the artificial reality. In one approach, the console compares the expected transmission end time and the expected process end time. The console may transmit, to the head wearable display in the first session, the additional data together with the image data, in response to the expected process end time being less than the expected transmission end time.

Latency reduction for artificial reality

The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Systems, devices, and methods for tiled multi-monochromatic displays

An optical assembly for a digital projector includes a lens and a field bias optical element. The lens is disposed to receive display light generated by a display and to direct the display light along an optical path. The lens is configured to provide a first field-of-view. The field bias optical element is disposed between the lens and an aperture stop of the optical assembly. The field bias optical element is configured to bias the display light in at least one direction to provide a second field-of-view that is greater than the first field-of-view.

Field bias optical element for digital projector

A super-resolution scanning display. The scanning display includes a light source, a conditioning assembly, and a scanning mirror assembly. The light source is configured to emit source light from a plurality of columns of emitters formed along a first dimension, including at least a first column of emitters emitting in a first band of light and a second column of emitters emitting in a second band of light which are offset along the first dimension by a fraction of an emitter width and offset along a second dimension&#x2014;that is orthogonal to the first dimension&#x2014;by greater than the emitter width. The conditioning assembly receives and conditions the source light. The scanning mirror assembly scans the conditioned light along the second dimension to generate a portion of an image at a first location with a resolution that is more than a first threshold number of emitters in a unit angle in the first dimension.

Super-resolution scanning display for near-eye displays

In one example, an apparatus comprises: a plurality of photodiodes, one or more charge sensing units, one or more analog-to-digital converters (ADCs), and a controller. The controller is configured to: enable the each photodiode to generate charge in response to a different component of the incident light; transfer the charge from the plurality of photodiodes to the one or more charge sensing units to convert to voltages; receive a selection of one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges; based on the selection, control the one or more ADCs to perform the selected one or more quantization processes to quantize the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the digital values.

A system tracks eye movement using optical coherence in a head mounted display. The system includes an illumination source configured to project low coherence interference light onto a portion of a user's eye. The system includes a scanning system to select an axial position within the illuminated portion of the user's eye. The system includes a detector configured to collect light reflected from the illuminated portion of the user's eye at the selected axial position, and the reflected light includes measurement data characterizing the illuminated portion of the user's eye. The system includes a controller configured to compare the measurement data with a trained baseline, and determine an eye position based the comparison.

Eye tracking using optical coherence methods

Growing community of inventors

Bothell, WA, United States of America

Nicholas Daniel Trail