Microsoft Technology Licensing, LLC

Robert Thomas Held

Anatolie Gavriliuc

Andrew Frederick Muehlhausen

Riccardo Giraldi

Bernard Charles Kress

Maxime Ouellet

Matthew Calbraith Crisler

Sergio Paolantonio

Semih Energin

Dmitry Reshidko

Christopher Charles Aholt

Ashley Saulsbury

Joel Steven Kollin

Andreas Georgiou

Kevin James MacKenzie

Christian Michael Sadak

Ishan Chatterjee

Michelle Chua

Maria Esther Pace

Eliezer Glik

Benjamin Eliot Lundell

Eric Scott Rehmeyer

David Anthony Evans

Joseph Van Den Heuvel

Mark Theodore Bolas

Stephen G Latta

Arthur Charles Tomlin

Ashraf A Michail

Szymon Piotr Stachniak

Martin Thomas Shetter

Dan Osborn

Gregory Alt

Todd Omotani

Andrew Martin Pearson

Richard Wifall

Sophia Siyuan Sun

Apriet Kenig

Richard Zachary Robinson

Ashraf Ayman Michail

David Evans

Richard J Wifall

Todd Alan Omotani

Kevin J Mackenzie

One disclosed example provides a near-eye display device. The near-eye display device comprises an eye tracking system configured to determine a position of an eye of a user relative to the near-eye display device, and a waveguide including at least an input coupler and an output coupler, the output coupler including a plurality of zones, each zone activatable via a dynamically controllable output coupling element of the zone. The near-eye display device further comprises an image source configured to output image light to the input coupler, and a controller configured to selectively activate one or more zones of the output coupler based at least on the position of the eye.

Dynamic control of waveguide eye box

Variable-focus lenses are arranged as a lens pair that work on opposite sides of a see-through optical combiner used in a mixed-reality head-mounted display (HMD) device. An eye-side variable-focus lens is configured as a negative lens over an eyebox of the see-through optical combiner to enable virtual-world objects to be set at a close distance. The negative lens is compensated by its conjugate using a real-world-side variable-focus lens configured as a positive lens to provide an unperturbed see-through experience. For non-presbyopes, the powers of the lenses are perfectly offset. For presbyopes, the lens powers is mismatched at times to provide simultaneous views of both virtual-world and real-world objects on the display in sharp focus. Responsively an eye tracker indicating that the user is engaged in close viewing, optical power is added to the real-world-side lens to push close real-world objects optically farther away into sharp focus for the presbyopic user.

Control of variable-focus lenses in a mixed-reality device for presbyopes

An optical combiner in a display system of a mixed-reality head-mounted display (HMD) device comprises a lens of birefringent material and a ferroelectric liquid crystal (FLC) modulator that are adapted for use with a reflective waveguide to provide multiple different focal planes on which holograms of virtual-world objects (i.e., virtual images) are displayed. The birefringent lens has two orthogonal refractive indices, ordinary and extraordinary, depending on the polarization state of the incident light. Depending on the rotation of the polarization axis by the FLC modulator, the incoming light to the birefringent lens is focused either at a distance corresponding to the ordinary refractive index or the extraordinary refractive index. Virtual image light leaving the birefringent lens is in-coupled to a see-through reflective waveguide which is configured to form an exit pupil for the optical combiner to enable an HMD device user to view the virtual images from the source.

Combined birefringent material and reflective waveguide for multiple focal planes in a mixed-reality head-mounted display device

Examples are disclosed that relate to using an array of hot mirrors in an eye-imaging system. One example provides a head-mounted display system, comprising a frame, an eye-imaging camera supported on the frame, a switchable hot mirror array comprising a plurality of switchable hot mirrors configured to direct light reflecting from an eye toward the eye-imaging camera, and a controller configured to control switching of a reflectivity of each of the plurality of switchable hot mirrors.

Eye-imaging system with switchable hot mirrors

Variable-focus lenses are arranged as a lens pair that work on opposite sides of a see-through optical combiner used in a mixed-reality head-mounted display (HMD) device. An eye-side variable-focus lens is configured as a negative lens over an eyebox of the see-through optical combiner to enable virtual-world objects to be set at a close distance. The negative lens is compensated by its conjugate using a real-world-side variable-focus lens configured as a positive lens to provide for an unperturbed see-through experience. For non-presbyopes, the powers of the lenses are perfectly offset. For presbyopes, the lens powers may be mismatched at times to provide simultaneous views of both virtual-world and real-world objects on the display in sharp focus. Responsively an eye tracker indicating that the user is engaged in close viewing, optical power is added to the real-world-side lens to push close real-world objects optically farther away and into sharp focus for the presbyopic user.

Stereoscopic display technologies are provided. A computing device generates a stereoscopic display of an object by coordinating a first image and a second image. To reduce discomfort or to reduce diplopic content, the computing device may adjust at least one display property of the first image and/or the second image depending on one or more factors. The factors may include a time period associated with the display of the object, the vergence distance to the object, the distance to the focal plane of the display, contextual data interpreted from the images and/or any combination of these and other factors. Adjustments to the display properties can include a modification of one or more contrast properties and/or other modifications to the images. The adjustment to the display properties may be applied with varying levels of intensity and/or be applied at different times depending on one or more factors and/or contextual information.

Stereoscopic display of objects

Systems and methods for controlling variable-focus functionality to reduce user discomfort in a mixed-reality system implement acts of obtaining a vergence depth of a gaze of a user, determining that the variable-focus lens for providing focus on virtual content viewed by the user is currently configured to provide focus at a depth that differs from the vergence depth, detecting that a triggering condition is present, and, in response to so detecting, selectively dampening an adjustment made to the variable-focus lens. In some implementations, the dampening causes the adjustment made to the variable-focus lens to reconfigure the variable-focus lens to provide focus at a depth that differs from the vergence depth.

Automated variable-focus lens control to reduce user discomfort in a head-mounted display

The disclosure herein describes controlling focal parameters of a head mounted display based on an estimated user age to account for increasing likelihood of presbyopia as user age increases. The head mounted display uses eye tracking sensors to collect ocular metric data associated with ocular features of a user's eye and a user age estimate is calculated based on analysis of the ocular metric data using a machine learning algorithm and an ocular metric data set. Further, a confidence value of the user age estimate is calculated based on the analysis of the ocular metric data. Then, focal parameters of the visual display of the head mounted display are controlled based on the user age estimate and confidence value. The described focal control method provides a seamless, automated way for a head mounted display system to adjust settings to provide a sharp, in-focus user experience for users of all ages.

Controlling focal parameters of a head mounted display based on estimated user age

A method for moving a virtual object includes displaying a virtual object and moving the virtual object based on a user input. Based on the user input attempting to move the virtual object in violation of an obstacle, displaying a collision indicator and an input indicator. The collision indicator is moved based on user input and movement constraints imposed by the obstacle. The input indicator is moved based on user input without movement constraints imposed by the obstacle.

Virtual object movement

Examples are disclosed herein that relate to calibrating a user's eye for a stereoscopic display. One example provides, on a head-mounted display device including a see-through display, a method of calibrating a stereoscopic display for a user's eyes, the method including for a first eye, receiving an indication of alignment of a user-controlled object with a first eye reference object viewable via the head-mounted display device from a perspective of the first eye, determining a first ray intersecting the user-controlled object and the first eye reference object from the perspective of the first eye, and determining a position of the first eye based on the first ray. The method further includes repeating such steps for a second eye, determining a position of the second eye based on a second ray, and calibrating the stereoscopic display based on the position of the first eye and the position of the second eye.

Calibrating a near-eye display

A technique is described herein for presenting notifications associated with applications in a context-based manner. In one implementation, the technique maintains a data store that provides application annotation information that describes a plurality of anchors. For instance, the application annotation information for an illustrative anchor identifies: a location at which the anchor is virtually placed in an interactive world; an application associated with the anchor; and triggering information that describes a set of one or more triggering conditions to be satisfied to enable presentation of a notification pertaining to the application. In use, the technique presents the notification pertaining to the application in prescribed proximity to the anchor when it is determined that the user's engagement with the interactive world satisfies the anchor's set of triggering conditions. The triggering conditions can specify any combination of spatial factors, temporal factors, user co-presence factors, etc.

Context-based discovery of applications

Examples are disclosed that relate to devices and methods for displaying stereo visual content via a head-mounted display (HMD) device. In one example, a method comprises: establishing a default display distance from an origin in a virtual coordinate system; determining a modified display distance from the origin; determining that visual content comprises stereo visual content comprising a left eye image and a right eye image; based on determining that the visual content comprises stereo visual content, scaling the left eye image to a scaled left eye image and scaling the right eye image to a scaled right eye image using a scaling factor that is proportional to a difference between the modified display distance and the default display distance; and displaying the scaled left eye image and the scaled right eye image at the modified display distance.

Displaying modified stereo visual content

Examples are disclosed herein related to reducing binocular rivalry in a near-eye display. One example provides a head-mounted display device having a near-eye display system configured to output a first-eye image to a first eyebox and a second-eye image to a second eyebox. The head-mounted display device is configured to receive an input of a three-dimensional (3D) location of a pupil of a first eye and a 3D location of a pupil of a second eye relative to the near-eye display system, based upon the 3D location of the pupil of the first eye and of the second eye, determine a location at which the pupil of the first eye begins to exit the first eyebox, and attenuate a luminance of the second-eye image at a location in the second-eye image based upon the location at which the pupil of the first eye begins to exit the first eyebox.

Mitigating binocular rivalry in near-eye displays

A scanned-beam display comprises an emitter configured to emit light of controlled variable intensity, a beam-steering optic configured to steer the light to a controlled variable beam position, and a drive circuit coupled operatively to the emitter and beam-steering optic. The drive circuit is configured to apply a signal to the beam-steering optic to move the beam position along a path of pixel positions, the path including a first pixel position at the center of the field-of-view and a second pixel position at the periphery of the field-of-view. The drive circuit is further configured to drive a series of current pulses through the emitter in synchronicity with the signal, to illuminate the first pixel position during a first interval and to equivalently illuminate the second pixel position during a second interval, the emitter being driven at a higher duty cycle during the second interval than during the first.

Variable emission period for scanned-beam display

Growing community of inventors

Seattle, WA, United States of America

Robert Thomas Held