Microsoft Technology Licensing, LLC

Google Inc.

X Development LLC

Bernard Charles Kress

Ishan Chatterjee

Joel Steven Kollin

Andreas Georgiou

Greg Ellis Priest-Dorman

Alfonsus Dibianto Lunardhi

Dmitry Reshidko

Robert Thomas Held

Maria Esther Pace

Ehsan Saeedi

Mario Possiwan

Ashley Saulsbury

Anurag Gupta

Eliezer Glik

Thad Eugene Starner

Hayes Solos Raffle

Adam Eales Norton

Jeffrey Neil Margolis

Ozan Cakmakci

Onur Can Akkaya

Richard Andrew Wall

Charles Thomas Hewitt

Hagar Edelstain

Joshua Owen Miller

Steven John Robbins

Brian Kevin Guenter

Sergio Ortiz Egea

Alex Olwal

Jani Kari Tapio Tervo

Xinye Lou

Scott Woltman

Edouard G Schmidtlin

Fei Chen

Michael George Boulton

Benjamin Eliot Lundell

Robert Warren Gruen

Christopher Charles Aholt

R Andrew Wall

Matthew Calbraith Crisler

Roberta Rene Moeur

Jeremy Brouillet

Marc Andrew Martinez

Weige Chen

Venkata Satya Raghavendra Bulusu

Mark Theodore Bolas

Jacob Hadnett-Hunter

Sohaib Abdul Rehman

Venkata Satya Reghavendra Bulusu

Greg E Priest-Dorman

This document relates to head mounted display devices. One example can include a housing configured to be positioned relative to a head and eye of a user and a transparent visual assembly positioned by the housing in front of the user's eye and comprising multiple eye tracking illuminators distributed across the transparent visual assembly and configured to emit non-visible light and multiple eye tracking detectors distributed across the transparent visual assembly and configured to detect the non-visible light reflected back from the eye of the user.

Eye tracking head mounted display device

Slanted surface relief gratings for use in an optical display system in an HMD device are replicated in a manufacturing process that utilizes non-contact optical proximity recording into a specialized photo-sensitive resin that is disposed over a waveguide substrate. The recording process comprises selective resin exposure to ultraviolet light through a mask to spatially record grating structures by interferential exposure and polymerization. Subsequent resin development evacuates unexposed resin down to the waveguide substrate to remove flat surfaces, referred to as a bias layer, that remain in the grating trenches after exposure. The resin development reduces Fresnel reflections that could otherwise be induced at the media interface between the bias layer and the waveguide substrate. Fresnel reflections may cause a loss of diffraction efficiency and thereby reduce the field of view that may be guided by the SRGs in the optical display system.

Slanted surface relief grating replication by optical proximity recording

Examples are disclosed that relate to compact optical systems comprising SLMs. One example provides a projection system comprising an illumination stage including a light emitting diode (LED) array. The LED array comprises a plurality of red LEDs, a plurality of green LEDs, and a plurality of blue LEDs. The illumination stage further comprises an illumination stage optical system configured to control an angular extent of light emitted by the LED array and homogenize the light emitted by the LED array. The projection system further comprises an image forming stage configured to form an image from light output by the illumination stage, the image forming stage comprising a spatial light modulator (SLM) configured to spatially modulate the light output by the illumination stage to form an image, and one or more projection optics configured to project the image formed by the spatial light modulator.

Illuminating spatial light modulator with LED array

A display engine adapted for use in a head-mounted display (HMD) device includes a reflective liquid crystal on silicon (LCoS) spatial light modulator (SLM) that is illuminated using a backlight illumination module and a pair of optical prisms providing a total internal reflection (TIR) function. In an illustrative mixed-reality embodiment, the TIR prism pair guides light to the LCoS SLM from the backlight illumination module and projects virtual images reflected from the LCoS SLM, through projection optics, to a diffractive waveguide combiner for viewing by an HMD user.

TIR prisms and use of backlight for LCoS microdisplay illumination

Variable-focus lenses are arranged as a lens pair that work on opposite sides of a see-through optical combiner used in a mixed-reality head-mounted display (HMD) device. An eye-side variable-focus lens is configured as a negative lens over an eyebox of the see-through optical combiner to enable virtual-world objects to be set at a close distance. The negative lens is compensated by its conjugate using a real-world-side variable-focus lens configured as a positive lens to provide an unperturbed see-through experience. For non-presbyopes, the powers of the lenses are perfectly offset. For presbyopes, the lens powers is mismatched at times to provide simultaneous views of both virtual-world and real-world objects on the display in sharp focus. Responsively an eye tracker indicating that the user is engaged in close viewing, optical power is added to the real-world-side lens to push close real-world objects optically farther away into sharp focus for the presbyopic user.

Control of variable-focus lenses in a mixed-reality device for presbyopes

Examples are disclosed relating to tunable attenuation of incident light using a switchable grating. One example provides an optical attenuator comprising a switchable grating configured to diffract light within a wavelength band at a diffraction angle. The optical attenuator further comprises an electrode pair configured to apply a voltage across the switchable grating to tune a proportion of incident light diffracted at the diffraction angle, and an optical dump to receive the proportion of incident light diffracted.

Optical attenuation via switchable grating

This document relates to an optical device that uses adaptive optics as part of an optical system. The adaptive optics can be used to correct light rays that correspond to a portion of an eye box based on information received from an eye-tracking unit, and can also correct for aberrations in the optics in the optical device. The adaptive optics include corrective elements that can be modified using modifying elements to correct the angle of light rays, such that rays associated with a specific pupil position and gaze direction of a user's eye can be made parallel and ensure a high quality image is viewed by the user.

Display with eye tracking and adaptive optics

An optical combiner in a display system of a mixed-reality head-mounted display (HMD) device comprises a lens of birefringent material and a ferroelectric liquid crystal (FLC) modulator that are adapted for use with a reflective waveguide to provide multiple different focal planes on which holograms of virtual-world objects (i.e., virtual images) are displayed. The birefringent lens has two orthogonal refractive indices, ordinary and extraordinary, depending on the polarization state of the incident light. Depending on the rotation of the polarization axis by the FLC modulator, the incoming light to the birefringent lens is focused either at a distance corresponding to the ordinary refractive index or the extraordinary refractive index. Virtual image light leaving the birefringent lens is in-coupled to a see-through reflective waveguide which is configured to form an exit pupil for the optical combiner to enable an HMD device user to view the virtual images from the source.

Combined birefringent material and reflective waveguide for multiple focal planes in a mixed-reality head-mounted display device

Examples are disclosed that relate to using an array of hot mirrors in an eye-imaging system. One example provides a head-mounted display system, comprising a frame, an eye-imaging camera supported on the frame, a switchable hot mirror array comprising a plurality of switchable hot mirrors configured to direct light reflecting from an eye toward the eye-imaging camera, and a controller configured to control switching of a reflectivity of each of the plurality of switchable hot mirrors.

Eye-imaging system with switchable hot mirrors

Variable-focus lenses are arranged as a lens pair that work on opposite sides of a see-through optical combiner used in a mixed-reality head-mounted display (HMD) device. An eye-side variable-focus lens is configured as a negative lens over an eyebox of the see-through optical combiner to enable virtual-world objects to be set at a close distance. The negative lens is compensated by its conjugate using a real-world-side variable-focus lens configured as a positive lens to provide for an unperturbed see-through experience. For non-presbyopes, the powers of the lenses are perfectly offset. For presbyopes, the lens powers may be mismatched at times to provide simultaneous views of both virtual-world and real-world objects on the display in sharp focus. Responsively an eye tracker indicating that the user is engaged in close viewing, optical power is added to the real-world-side lens to push close real-world objects optically farther away and into sharp focus for the presbyopic user.

Embodiments are disclosed for an optical waveguide display configured for use with a near-eye display (NED) device. In an embodiment the waveguide display includes a light-transmissive substrate and an optical coupling element configured to input light rays to the substrate or output light rays from the substrate, the optical coupling element configured to deflect a plurality of wavelengths of an incident light ray collinearly for propagation within the light-transmissive substrate through total internal reflection (TIR). The optical coupling element can include a pattern of nano-structures that collectively form a metasurface on the substrate.

Metasurface optical coupling elements for a display waveguide

A head-mounted display device including one or more position sensors and a processor. The processor may receive a rendered image of a current frame. The processor may receive position data from the one or more position sensors and determine an updated device pose based on the position data. The processor may apply a first spatial correction to color information in pixels of the rendered image at least in part by reprojecting the rendered image based on the updated device pose. The head-mounted display device may further include a display configured to apply a second spatial correction to the color information in the pixels of the rendered image at least in part by applying wobulation to the reprojected rendered image to thereby generate a sequence of wobulated pixel subframes for the current frame. The display may display the current frame by displaying the sequence of wobulated pixel subframes.

Reprojection and wobulation at head-mounted display device

An augmented reality display device includes a near-eye display configured to present imagery to a user eye. A camera is configured to capture light from a real-world environment and produce output useable to contribute to the imagery presented to the user eye via the near-eye display. The camera includes an aperture configured to receive the light from the real-world environment and an image sensor configured to respond to the light received from the real-world environment by generating sensor output signals useable to produce images on the near-eye display depicting the real-world environment. One or more optical elements provide an optical path for light from the aperture to the image sensor, the optical path having a length that is within a threshold of a distance between the user eye and the aperture of the camera.

Camera for augmented reality display

Growing community of inventors

Redwood City, CA, United States of America

Bernard Charles Kress