Microsoft Technology Licensing, LLC

Richard Andrew Wall

Dmitry Reshidko

Joseph Daniel Lowney

Tuomas Heikki Sakari Vallius

Ian Anh Nguyen

Bernard Charles Kress

Joshua Owen Miller

Steven John Robbins

Tuomas Vallius

Richard Allen James

Joel Steven Kollin

Andrew Maimone

Mikko Juhola

Yarn Chee Poon

Jani Kari Tapio Tervo

Jeb Wu

Xinye Lou

Steve Robbins

Eliezer Glik

Angus Wu

James Randolph Webster

Heikki Juhana Hyvarinen

Nicholas Mark Cirucci

Robin Hsiung

RuPing Huang

Freeway Lin

Examples are disclosed that relate to a display device. One example provides a display device comprising a projector and a pre-expander optic configured to replicate an exit pupil of the projector in at least a first direction, the pre-expander optic comprising a plurality of spectrally-selective pupil-replicating elements to form at least two exit pupils at different spatial locations, each exit pupil being for a different spectral band. The display device further comprises a waveguide comprising at least two incoupling pupils, each incoupling pupil configured to receive light from a corresponding exit pupil of the pre-expander optic, and the waveguide configured to replicate each corresponding exit pupil in at least a second direction and output the light received toward an eyebox.

Pupil-expanding display device

An eye-tracking system is provided. The system includes an at least partially transparent visible light waveguide having a visible light display region configured to emit visible light to impinge upon an eye of a user. A light source is configured to emit at least infrared (IR) light that travels along an IR light path to impinge on the eye. A microelectromechanical system (MEMS) scanning mirror positioned in the IR light path is configured to direct the IR light along the IR light path. A relay positioned in the IR light path downstream of the MEMS scanning mirror includes at least one mirror configured to reflect the IR light along the IR light path. At least one sensor is configured to receive the IR light after being reflected by the eye.

Eye-tracking with MEMS scanning and reflected light

Examples are disclosed that relate to expanding an exit pupil of a display device via a curved waveguide. One example provides a curved waveguide, including an input coupler configured to couple light into the curved waveguide, a first reflective surface, a second reflective surface opposing the first reflective surface, and an output coupler configured to couple the light out of the curved waveguide. The curved waveguide also has a curvature in a direction transverse to an optical path between the input coupler and the output coupler, the curvature having a radius that varies along a direction extending between the input coupler and the output coupler.

Exit pupil expansion via curved waveguide

An eye-tracking system includes an at least partially transparent visible light waveguide having a visible light display region configured to emit visible light to an eye of a user. A light source is configured to emit at least infrared (IR) light that travels along an IR light path to the eye of the user. A microelectromechanical system (MEMS) projector positioned in the IR light path directs the IR light. At least one diffractive input coupler on an input end of the IR light path downstream of the MEMS projector diffracts at least a portion of the IR light. At least one diffractive output coupler positioned in the IR light path downstream of the diffractive input coupler receives the IR light and directs the IR light toward the eye. At least one sensor is configured to receive the IR light after being reflected by the eye.

Eye-tracking system positioning diffractive couplers on waveguide

A light engine comprises a liquid crystal on silicon (LCOS) panel that is operated in combination with illumination and imaging optics to project high-resolution virtual images into a waveguide-based exit pupil expander (EPE) that provides an expanded exit pupil in a near-eye display system. In an illustrative example, the illumination optics comprise a laser that produces illumination light that is reflected by a MEMS (micro-electromechanical system) scanner using raster scanning to post-scan optics including a microlens array (MLA) and one or more collimating or magnifying lenses before impinging on the LCOS panel. The LCOS panel operates in reflection in combination with imaging optics, including one or more of beam-steering mirror and beam splitter, to couple virtual image light from the LCOS panel into the EPE.

Scanner-illuminated LCOS projector for head mounted display

An input-coupler of an optical waveguide includes one or more Bragg polarization gratings for coupling light corresponding to the image in two different directions into the optical waveguide. The input-coupler splits the FOV of the image coupled into the optical waveguide into first and second portions by diffracting a portion of the light corresponding to the image in a first direction toward a first intermediate component, and diffracting a portion of the light corresponding to the image in a second direction toward a second intermediate component. An output-coupler of the waveguide combines the light corresponding to the first and second portions of the FOV, and couples the light corresponding to the combined first and second portions of the FOV out of the optical waveguide so that the light corresponding to the image and the combined first and second portions of the FOV is output from the optical waveguide. The input-coupler splitting the light to two or more intermediate components provides an increased FOV.

Field of view tiling in waveguide-based near-eye displays

Devices, systems, and methods corresponding to addressing misalignment in display systems are provided. A method includes using a first microelectromechanical system (MEMS) mirror, directing a first signal from a first light source to an alignment tracking waveguide. The method further includes receiving by a first photosensor a first portion of the first signal via the alignment tracking waveguide and determining a first alignment indicator associated with the first portion of the first signal. The method further includes using a second MEMS mirror, directing a second signal from a second light source to the alignment tracking waveguide. The method further includes receiving by a second photosensor a second portion of the second signal via the alignment tracking waveguide and determining a second alignment indicator associated with the second portion of the second signal.

Display alignment tracking in display systems

A waveguide-based pupil relay for an optical system can comprise a light-transmissive substrate that includes a plurality of internally reflective surfaces to enable light rays of a plurality of different colors to propagate through the substrate by total internal reflection. The pupil relay can further include an input surface to input light rays of the plurality of different colors through an entry pupil of the optical waveguide, and an output surface to output light rays of the plurality of different colors from the substrate through an exit pupil of the optical waveguide. The pupil relay can have optical properties such that the entry pupil and exit pupil have substantially identical size and shape and such that the input light rays and output light rays have substantially identical chromatic properties.

Waveguide pupil relay

A resonating optical waveguide that increases image intensity and uniformity is provided. The waveguide includes a first diffractive optical element that allows light from an exit pupil of a projector to enter the waveguide and travel in a first direction, and a second diffractive optical element that directs some of the entered light to exit the waveguide to form an expanded pupil. Rather than allow the remaining, non-directed, light to exit at an edge of the waveguide, the optical waveguide further includes a third diffractive optical element that redirects some the remaining light back through the second diffractive optical element in a second direction where it may exit the waveguide as part of the expanded pupil. An additional fourth diffractive optical element may be included to further redirect the light through the second diffractive optical element again.

Resonating optical waveguide using multiple diffractive optical elements

An eye-tracking system is provided that includes a light source configured to emit at least infrared (IR) light and a microelectromechanical system (MEMS) scanning mirror configured to direct the IR light. The system further includes a relay including at least one prism, and the relay is configured to receive the IR light directed by the MEMS scanning mirror and redirect the IR light. The system further includes a waveguide through which the IR light redirected by the relay passes to reach an eye, and at least one sensor configured to receive the IR light after being reflected by the eye.

Eye-tracking with MEMS scanning and optical relay

A waveguide increases the optical path of a portion of light received from a coherent light source. The waveguide includes a first element that allows light from an exit pupil of a coherent light source to enter the waveguide, and a second element that directs some of the entered light to exit the waveguide through a first set of pupils. The waveguide includes additional elements that cause the remaining light to make an additional path through the waveguide and the second element before exiting through a second set of pupils to increase the path of the exiting light. The pupils of the first set and the second set are staggered so that light exiting a pupil does not interfere with the light exiting via the neighboring pupils.

Optical waveguide with coherent light source

An augmented reality display system utilized in computing platforms such as wearable head-mounted display (HMD) devices includes a virtual reality display that is located in front of a user's eyes to provide a direct view of virtual world images. An optical periscope, comprising reflective or diffractive optical systems, is configured to provide an indirect view of the real world. By locating the virtual reality display (and its associated optical and electrical components) close to the user's eyes and within the user's direct line of sight, the field of view (FOV) of the virtual world is increased as compared with conventional indirect-view virtual reality displays. The optical periscope provides an FOV of the real world that would otherwise be obstructed by the positioning of the direct-view virtual reality display in front of the user's eyes.

Indirect-view augmented reality display system

An optical light engine includes a pair of lenticular microlenslet arrays (MLAs) located on each side of a polarization converter. Non-polarized light from a source in the engine is focused by the first MLA onto cells of the polarization converter which converts the light to a common state of polarization to increase efficiency and improve contrast in the system. A half wave retarder is included on the polarization converter to change the polarization of any light that is reflected from downstream optical components to match that of the forward propagating light. The second MLA, which includes a relatively large number of microlenslet elements, collects the light from the polarization converter and homogenizes the light to be highly uniform when received at a downstream imaging panel in the light engine such as a liquid crystal on silicon (LCOS) panel.

Light engine with lenticular microlenslet arrays

A near eye or heads up display system includes a scan beam projector engine, an optical waveguide, and an exit pupil expander (EPE) optically coupled between the scan beam projector engine and the optical waveguide. The EPE improves the optical performance of the display system. The EPE could include a diffusive optical element, diffractive optical element, micro-lens array (MLA), or relay of aspherical lenses. A dual MLA EPE may have cells that prevent cross-talk between adjacent pixels. A dual MLA EPE may have a non-periodic lens array. The optical power of one MLA may be different from the other MLA.

Growing community of inventors

Kirkland, WA, United States of America

Richard Andrew Wall