Facebook Technologies, LLC

Meta Platforms Technologies, LLC

Nvidia Corporation

Massachusetts Institute of Technology

Oculus, Vr, LLC

Douglas Robert Lanman

Alexander Jobe Fix

Brian M Wheelwright

Yusufu Njoni Bamaxam Sulai

David Patrick Luebke

Afsoon Jamali

Andrew Maimone

Nicholas Daniel Trail

Marina Zannoli

Lu Lu

Robert Dale Cavin

Hee Yoon Lee

Ryan Michael Ebert

Kevin James MacKenzie

Ying Geng

Scott Charles McEldowney

Matthieu Charles Raoul Leibovici

Stephen James McNally

Nathan Seigo Matsuda

Wai Sze Tiffany Lam

Gerrit Ary Slavenburg

Thomas Francis Fox

Nicholas Colonnese

Ramesh Raskar

Jasmine Soria Sears

Anton S Kaplanyan

Jacques Gollier

Oleg Yaroshchuk

Wanli Chi

Jan Kautz

Fenglin Peng

Junren Wang

Gang Li

Gordon Wetzstein

Kari Pulli

Andrew John Ouderkirk

Pasi Saarikko

Mengfei Wang

Wolfgang Heidrich

Kevin Mackenzie

Yang Zhao

Olivier Mercier

James Hillis

Bruce A Cleary

Lei Xiao

Ganghun Kim

Joyce S Fang

Derek Nowrouzezahrai

Alireza Moheghi

William Aaron Nicholls

Matthew Waggener Hirsch

Matthew Steven Chapman

Austin Wilson

Kavitha Ratnam

Robert Konrad

Brett Joseph Bryars

Felix Heide

Yun Hee Kim

Dikpal Reddy

Michael Sean Mounier

Szymon Jakubczak

Ankit Mohan

Ian Erkelens

Shinsaku Hiura

Joel Hegland

Andrew Stephen Maimone

Henry Holtzman

Robert Birch

Grace Elizabeth Kuo

Julian Iseringhausen

Nicholas Diorio

Robin Joseph Swanson

Salah Eddine Nouri

Kristen Bowles

Numair Khalil Ullah Khan

Aaron Nicholls

Yusufu Sulai

A method for generating tiled multiplane images from a source image is disclosed. The method includes obtaining color and depth images. The method also includes extracting a feature map using a first neural network. The method also includes generating masks for a tile using a second neural network based on a corresponding tile of the feature map and corresponding sections of the color and depth images. The method also includes computing depths of a planes corresponding to the tile based on the masks. The method also includes generating a per-tile multiplane image for the tile based on the masks. The method also includes rendering an image using per-tile multiplane images and depths. A system for generating tiled multiplane images from a source image is also disclosed.

Neural view synthesis using tiled multiplane images

A display device includes a display module for providing first image light. The display device also includes a first optical element for receiving and transmitting the first image light from the display module. The display module includes a region from which the first image light is provided in directions other than a direction perpendicular to the first optical element. The display device further includes a second optical element so that the second optical element receives the first image light transmitted through the first optical element and sends the received first image light back toward the first optical element as second image light. The first optical element receives the second image light from the second optical element and sends the second image light back toward the second optical element, and the second optical element receives and transmits the second image light from the first optical element.

High efficiency optical assembly with folded optical path

A display system includes a source of unpolarized image light, and a stack of polarization-selective optical elements operable to switchably convert the unpolarized image light into two orthogonally polarized light beams, each of which being switchable in at least one beam characteristic. An output polarizer selects one of the two orthogonally polarized light beams for providing to a user. A depolarizer may be disposed between an electronic display emitting polarized light and the stack. The depolarizer may be in the form of an LC bilayer with randomized in-plane optic axis.

Polarization-based processing of unpolarized image light

According to examples, a head-mounted display (HMD) headset may include at least two exterior-facing color cameras mounted on the front face of the HMD and in the same visual plane as the user's eyes. The at least two exterior-facing color cameras may collect images for stereo view synthesis. The HMD may include a processor, and a memory storing instructions, which when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least one of depth estimation, imaging sharpening, forward splatting, disocclusion filtering, or fusion.

Display system with machine learning (ML) based stereoscopic view synthesis over a wide field of view

An optical assembly includes a Fresnel lens and a diffractive optical element. The Fresnel lens includes a high-refractive-index material having a refractive index greater than 1.9. The diffractive optical element is optically coupled with the Fresnel lens to compensate for chromatic aberration caused by the Fresnel lens. A method for imaging light with the optical assembly is also disclosed.

Optical assembly with high-refractive-index Fresnel lens and chromatic aberration corrector

A volumetric display may include a two-dimensional display; a varifocal optical system configured to receive image light from the two-dimensional display and focus the image light; and at least one processor configured to: control the two-dimensional display to cause a plurality of sub-frames associated with an image frame to be displayed by the display, wherein each sub-frame of the plurality of sub-frames includes a corresponding portion of image data associated with the image frame; and control the varifocal optical system to a corresponding focal state for each respective sub-frame.

Volumetric display including liquid crystal-based lenses

A head-mounted display device includes a first set of one or more lenses and a first display configured to provide visual data through the first set of one or more lenses. The head-mounted display device further includes a first stepper motor mechanically coupled to the first display, and the first stepper motor is configured to move the first display along a first axis by rotating a rotatable component of the first stepper motor. The head-mounted display device further includes a first electronic controller configured to (i) determine a first position of the first display, (ii) receive information identifying a second position of the first display, and (iii) generate one or more electrical signals that cause the first stepper motor to move the first display from the first position to the second position along the first axis.

Head-mounted display device with stepper motors for moving displays

A head-mounted display device for providing images to a wearer includes a focus-supporting light projector and a beam steerer. The focus-supporting light projector is configured to project light for rendering images based at least on virtual reality contents and/or augmented reality contents. The light projected from the focus-supporting light projector corresponds to an image plane that is selected based at least in part on a position of a pupil of an eye of the wearer. The beam steerer is configured to change a path of the light projected from the focus-supporting light projector based on the position of the pupil of the eye of the wearer.

Augmented reality head-mounted display with a focus-supporting projector for pupil steering

A device includes a first-type liquid crystal (LC) lens configured to provide a first optical power that is variable in a first step resolution. The device also includes a second-type LC lens coupled with the first-type LC lens, and configured to provide a second optical power that is variable in a second step resolution. The first step resolution is smaller than the second step resolution. A total optical power of the device is a sum of the first optical power and the second optical power, and is variable in the first step resolution.

Varifocal system using hybrid tunable liquid crystal lenses

A system is provided. The system includes a display configured to output a virtual image. The system also includes a lens assembly optically coupled to the display and including a plurality of optical lenses. The system also includes a controller configured to selectively activate one or more of the plurality of optical lenses, determine a lens center shift between a center of the selectively activated one or more of the plurality of optical lenses and a center of the lens assembly, and determine an image shift based on the lens center shift for shifting the virtual image output from the display.

Optical system using segmented phase profile liquid crystal lenses

An optical assembly includes a plurality of successive optical stages that are configured to transmit light at a variable overall optical power by configuring one or more stages of the successive optical stages. A respective optical stage of the successive optical stages includes an active optical element that is configurable to be in a first state at a first time and a second state at a second time that is distinct from the first time. The active optical element, in the first state, has a first respective optical power for light of a first polarization and a second respective optical power, that is different from the first respective optical power, for light of a second polarization that is orthogonal to the first polarization. The active optical element, in the second state, has a third optical power for light of the first polarization and light of the second polarization.

Display device with varifocal optical assembly

A head mounted display (HMD) includes a set of one or more lenses defining an optical axis, a display configured to project light through the set of the one or more lenses, a voice coil actuator coupled with the display and configured to move the display along the optical axis, and a first guide that is separate from the first voice coil actuator and coupled with the first display to guide the movement of the first display. The HMD additionally includes a set of one or more position sensors configured to determine a position of the display long the optical axis and an electronic controller configured to receive information identifying a reference position of the display along the optical axis and generate one or more electrical signals for initiating a movement of the first display toward the first reference point along the optical axis.

Head-mounted display device with voice coil motors for moving displays

A head-mounted display device includes one or more lenses and a display configured to provide visual data through the one or more lenses. The head-mounted display device also includes a direct-current (DC) motor mechanically coupled to the display, and the DC motor is configured to move the display along an axis by rotating a rotatable component of the DC motor. The head-mounted display device further includes: position sensor(s) configured to determine a position of the display, and electronic controller(s) in communication with the position sensor(s). The electronic controller(s) are configured to: (i) receive, from the position sensor(s), the determined position of the display as a first position of the display, (ii) receive information identifying a second position of the display, and (iii) generate electrical signal(s) that cause the DC motor to move the display from the first position to the second position along the axis.

Head-mounted display device with direct-current (DC) motors for moving displays

A device includes a light source configured to emit an image light. The device also includes an optical assembly configured to direct the image light to an eye-box of the device. The optical assembly includes a first optical element portion configured to focus a first portion of the image light propagating through the first optical element portion. The optical assembly also includes a second optical element portion configured to focus a second portion of the image light propagating through the second optical element portion. The second optical element portion includes a liquid crystal ('LC') lens having an adjustable optical power.

Accommodation bifocal optical assembly and optical system including same

Growing community of inventors

Bellevue, WA, United States of America

Douglas Robert Lanman