Magic Leap, Inc.

University of Washington

Visualant, Inc.

Molecular Imprints, Inc.

Visulant, Inc.

Brian T Schowengerdt

Rony Abovitz

Mathew David Watson

John Graham Macnamara

Mark Baerenrodt

Christopher M Harrises

Nicole Elizabeth Samec

Michael Anthony Klug

Charles David Melville

Samuel A Miller

Lionel Ernest Edwin

Pierre St Hilaire

Paul M Greco

Eric J Seibel

Ivan Li Chuen Yeoh

William Hudson Welch

Robert Dale Tekolste

Thomas Adrian Furness, Iii

Vikramjit Singh

Michael Nevin Miller

Christophe Peroz

Robert D TeKolste

Matthew David Watson

Hui-Chuan Cheng

Samuel Scott Frank

Nicholas E Walker

Jie Sun

Richard Stephen Johnston

Hong Hua

Victor Kai Liu

Samarth Bhargava

David Tinch

Aaron Mark Schuelke

Ross D Melville

William A Lee

Cameron M Lee

Bradley E Sparks

Sarah Colline McQuaide

Kevin R Curtis

Chulwoo Oh

Ivan L Yeoh

Dianmin Lin

Gordon Wetzstein

Michal Beau Dennison Vaughn

Robert Konrad

Abhijith Rajiv

Steven Alexander-Boyd Hickman

Brandon Michael-James Born

Steven L Brunton

Chen Gong

Frank Y Xu

Jahja I Trisnadi

Eric C Browy

Vaibhav Mathur

Timothy Mark Dalrymple

Jason A Schaefer

Jeffrey Dean Schmulen

Alejandro Lopez

An-Shyang Chu

Gary R Bradski

Michael Denton

Alan Tompkins

Emma Rae Mullen

Laura Cristina Trutoiu

Allan David Beach

Richard Ian Mander

Benjamin John Kuehn

Mathew D Watson

Winyu Chinthammit

Mina Rohani

Robert A Burstein

Nils Benjamin Erichson

Konrad E Schroder

Nicole Elizabeth Samee

Aaron Shuelke

Mike Nevin Miller

William Andrew Lee

Michal Beau Vaughn

Scott Frank

Kevin Richard Curtis

Matthew D Watson

Ivan Li Yeoh

An eye tracking system includes a pair of glasses including two frames, a projector coupled to the pair of glasses and operable to project a beam of light, and an eyepiece mounted in one of the two frames and optically coupled to the projector. The eyepiece is operable to direct at least a portion of the beam of light towards an eye of a user. The eye tracking system also includes one or more optical sensors coupled to at least one of the two frames of the pair of glasses and operable to detect a set of reflected signals off the eye of the user, and a processor coupled to the projector and the one or more optical sensors, wherein the processor is operable to determine an eye orientation based on the set of reflected signals.

Method and system for tracking eye movement in conjunction with a light scanning projector

A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.

Method for generating a virtual user interface

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

Frame-by-frame rendering for augmented or virtual reality systems

Disclosed is an improved diffraction structure for 3D display systems. The improved diffraction structure includes an intermediate layer that resides between a waveguide substrate and a top grating surface. The top grating surface comprises a first material that corresponds to a first refractive index value, the underlayer comprises a second material that corresponds to a second refractive index value, and the substrate comprises a third material that corresponds to a third refractive index value. According to additional embodiments, improved approaches are provided to implement deposition of imprint materials onto a substrate, which allow for very precise distribution and deposition of different imprint patterns onto any number of substrate surfaces.

Manufacturing for virtual and augmented reality systems and components

Configurations are disclosed for a health system to be used in various healthcare applications, e.g., for patient diagnostics, monitoring, and/or therapy. The health system may comprise a light generation module to transmit light or an image to a user, one or more sensors to detect a physiological parameter of the user's body, including their eyes, and processing circuitry to analyze an input received in response to the presented images to determine one or more health conditions or defects.

Augmented and virtual reality display systems and methods for diagnosing health conditions based on visual fields

Architectures are provided for selectively incoupling one or more streams of light from a multiplexed light stream into a waveguide. The multiplexed light stream can have light with different characteristics (e.g., different wavelengths and/or different polarizations). The waveguide can comprise in-coupling elements that can selectively couple one or more streams of light from the multiplexed light stream into the waveguide while transmitting one or more other streams of light from the multiplexed light stream.

Display system with optical elements for in-coupling multiplexed light streams

Techniques for tracking eye movement in an augmented reality system identify a plurality of base images of an object or a portion thereof. A search image may be generated based at least in part upon at least some of the plurality of base images. A deep learning result may be generated at least by performing a deep learning process on a base image using a neural network in a deep learning mode. A captured image may be localized at least by performing an image registration process on the captured image and the search image using a Kalman filter model and the deep learning result.

Eye tracking in near-eye displays

An eyepiece includes a planar waveguide having a front surface and a back surface. The eyepiece also includes a grating coupled to the back surface of the planar waveguide and configured to diffract a first portion of the light propagating in the planar waveguide out of a plane of the planar waveguide toward a first direction and to diffract a second portion of the light propagating in the planar waveguide out of the plane of the planar waveguide toward a second direction opposite to the first direction and a wavelength-selective reflector coupled to the front surface of the planar waveguide. The wavelength-selective reflector comprises a multilevel metasurface comprising a plurality of spaced apart protrusions having a pitch and formed of a first optically transmissive material and a second optically transmissive material disposed between the spaced apart protrusions.

Multi-layer diffractive eyepiece having multilevel metasurface

Augmented reality and virtual reality display systems and devices are configured for efficient use of projected light. In some aspects, a display system includes a light projection system and a head-mounted display configured to project light into an eye of the user to display virtual image content. The head-mounted display includes at least one waveguide comprising a plurality of in-coupling regions each configured to receive, from the light projection system, light corresponding to a portion of the user's field of view and to in-couple the light into the waveguide; and a plurality of out-coupling regions configured to out-couple the light out of the waveguide to display the virtual content, wherein each of the out-coupling regions are configured to receive light from different ones of the in-coupling regions. In some implementations, each in-coupling region has a one-to-one correspondence with a unique corresponding out-coupling region.

Augmented and virtual reality display systems with correlated in-coupling and out-coupling optical regions for efficient light utilization

A virtual image generation system comprises a planar optical waveguide having opposing first and second faces, an in-coupling (IC) element configured for optically coupling a collimated light beam from an image projection assembly into the planar optical waveguide as an in-coupled light beam, a first orthogonal pupil expansion (OPE) element associated with the first face of the planar optical waveguide for splitting the in-coupled light beam into a first set of orthogonal light beamlets, a second orthogonal pupil expansion (OPE) element associated with the second face of the planar optical waveguide for splitting the in-coupled light beam into a second set of orthogonal light beamlets, and an exit pupil expansion (EPE) element associated with the planar optical waveguide for splitting the first and second sets of orthogonal light beamlets into an array of out-coupled light beamlets that exit the planar optical waveguide.

Systems and methods for mixed reality

A method and system for increasing dynamic digitized wavefront resolution, i.e., the density of output beamlets, can include receiving a single collimated source light beam and producing multiple output beamlets spatially offset when out-coupled from a waveguide. The multiple output beamlets can be obtained by offsetting and replicating a collimated source light beam. Alternatively, the multiple output beamlets can be obtained by using a collimated incoming source light beam having multiple input beams with different wavelengths in the vicinity of the nominal wavelength of a particular color. The collimated incoming source light beam can be in-coupled into the eyepiece designed for the nominal wavelength. The input beams with multiple wavelengths take different paths when they undergo total internal reflection in the waveguide, which produces multiple output beamlets.

Method and system for high resolution digitized display

A method of operating an eyepiece waveguide includes directing light from a projector to impinge on an incoupling grating (ICG). The method also includes diffracting a first fraction of the light from the projector into a first portion of the eyepiece waveguide, propagating the first fraction of the light into a second portion of the eyepiece waveguide, and diffracting the first fraction of the light out of the eyepiece waveguide. The method further includes diffracting a second fraction of the light from the projector into the second portion of the eyepiece waveguide, propagating the second fraction of the light into the first portion of the eyepiece waveguide, and diffracting the second fraction out of the eyepiece waveguide.

Method and system for dual projector waveguide displays with wide field of view

Architectures are provided for selectively outputting light for forming images, the light having different wavelengths and being outputted with low levels of crosstalk. In some embodiments, light is incoupled into a waveguide and deflected to propagate in different directions, depending on wavelength. The incoupled light then outcoupled by outcoupling optical elements that outcouple light based on the direction of propagation of the light. In some other embodiments, color filters are between a waveguide and outcoupling elements. The color filters limit the wavelengths of light that interact with and are outcoupled by the outcoupling elements. In yet other embodiments, a different waveguide is provided for each range of wavelengths to be outputted. Incoupling optical elements selectively incouple light of the appropriate range of wavelengths into a corresponding waveguide, from which the light is outcoupled.

Architectures and methods for outputting different wavelength light out of waveguides

Images perceived to be substantially full color or multi-colored may be formed using component color images that are distributed in unequal numbers across a plurality of depth planes. The distribution of component color images across depth planes may vary based on color. In some embodiments, a display system includes a stack of waveguides that each output light of a particular color, with some colors having fewer numbers of associated waveguides than other colors. The waveguide stack may include multiple pluralities (e.g., first and second pluralities) of waveguides, each configured to produce an image by outputting light corresponding to a particular color. The total number of waveguides in the second plurality of waveguides may be less than the total number of waveguides in the first plurality of waveguides, and may be more than the total number of waveguides in a third plurality of waveguides, in embodiments that utilize three component colors.

Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes

A method of displaying an image to a viewer includes operating a fiber scanning projector to produce a scanned light beam incident on an incoupling diffractive optical element (DOE) coupled to a waveguide. A portion of the light beam is reflected via a reflective back surface of the incoupling DOE. The reflected portion of the scanned light beam is incident on a reflective optical element, which reflects the light beam back to the incoupling DOE. The returning light beam is then diffracted by the incoupling DOE to produce a second pass first diffracted light beam. The second pass first diffracted light beam is propagated within the planar waveguide via total internal reflection (TIR) to an outcoupling DOE, which directs a portion of the second pass first diffracted light beam toward an eye of a viewer to display the image to the user.

Method and system for fiber scanning projector with angled eyepiece

Growing community of inventors

Seattle, WA, United States of America

Brian T Schowengerdt