Microsoft Technology Licensing, LLC

Tony Ambrus

Stephen G Latta

Arthur Charles Tomlin

Brian James Mount

Ryan Lucas Hastings

Daniel Joseph McCulloch

Jonathan Steed

Aaron Daniel Krauss

Michael Scavezze

Ian Douglas McIntyre

Nicholas Ferianc Kamuda

Peter Tobias Kinnebrew

Nicholas Fajt

Mike Scavezze

Wei Zhang

Relja Markovic

Ben J Sugden

Jason Bradley Scott

Alex A Kipman

Adam G Poulos

Cameron Graeme Brown

Robert L Crocco, Jr

Laura K Massey

Brian E Keane

Kevin Geisner

Kathleen Patricia Mulcahy

Frederik Schaffalitzky

Jeffrey C Fong

Ethan Eade

Aaron Mackay Burns

Jeffrey Cole

Daniel Deptford

Jamie Bryant Kirschenbaum

Thomas Salter

John Bevis

Michael Klucher

Zachary Quarles

Drew Edward Steedly

Georg Klein

Aaron N Woo

Gerhard A Schneider

Quentin Simon Charles Miller

Scott Robert Ramsby

Robert Pengelly

Matthew Sammis Ashman

Adam Benjamin Smith-Kipnis

Andrew Wyman MacDonald

Roger Sebastian Sylvan

Matthew Kaplan

Abby Lin Lee

Ron Amador-Leon

Katelyn Doran

Olivia M Janik

Udiyan I Padmanahan

Russ McMackin

Arnulfo Zepeda

Andrew Wyman Macdonald

Katelyn Elizabeth Doran

Russ Mcmackin

Scott Ramsby

Ian Douglas Mclntyre

Ian Mcintyre

Daniel Mcculloch

Matthew G Kaplan

Daniel Joseph Mcculloch

Nicholas Gervase Fajt

Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

Constructing augmented reality environment with pre-computed lighting

Embodiments are disclosed for methods and systems of distinguishing movements of features in a physical environment. For example, on a head-mounted display device, one embodiment of a method includes obtaining a representation of real-world features in two or more coordinate frames and obtaining motion data from one or more sensors external to the head-mounted display device. The method further includes distinguishing features in one coordinate frame from features in another coordinate frame based upon the motion data.

Determining coordinate frames in a dynamic environment

Various embodiments relating to selection of a user interface object displayed on a graphical user interface based on eye gaze are disclosed. In one embodiment, a selection input may be received. A plurality of eye gaze samples at different times within a time window may be evaluated. The time window may be selected based on a time at which the selection input is detected. A user interface object may be selected based on the plurality of eye gaze samples.

Selection using eye gaze evaluation over time

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Indicating out-of-view augmented reality images

Various embodiments relating to creating a virtual shadow of an object in an image displayed with a see-through display are provided. In one embodiment, an image of a virtual object may be displayed with the see-through display. The virtual object may appear in front of a real-world background when viewed through the see-through display. A relative brightness of the real-world background around a virtual shadow of the virtual object may be increased when viewed through the see-through display. The virtual shadow may appear to result from a spotlight that is fixed relative to a vantage point of the see-through display.

Mixed reality spotlight

Embodiments related to improving a color-resolving ability of a user of a see-thru display device are disclosed. For example, one disclosed embodiment includes, on a see-thru display device, constructing and displaying virtual imagery to superpose onto real imagery sighted by the user through the see-thru display device. The virtual imagery is configured to accentuate a locus of the real imagery of a color poorly distinguishable by the user. Such virtual imagery is then displayed by superposing it onto the real imagery, in registry with the real imagery, in a field of view of the user.

Color vision deficit correction

Embodiments are disclosed that relate to placing virtual objects in an augmented reality environment. For example, one disclosed embodiment provides a method comprising receiving sensor data comprising one or more of motion data, location data, and orientation data from one or more sensors located on a head-mounted display device, and based upon the motion data, determining a body-locking direction vector that is based upon an estimated direction in which a body of a user is facing. The method further comprises positioning a displayed virtual object based on the body-locking direction vector.

Body-locked placement of augmented reality objects

A method for displaying virtual imagery on a stereoscopic display system having a display matrix. The virtual imagery presents a surface of individually renderable loci viewable to an eye of the user. The method includes, for each locus of the viewable surface, illuminating a pixel of the display matrix. The illuminated pixel is chosen based on a pupil position of the eye as determined by the stereoscopic display system. For each locus of the viewable surface, a virtual image of the illuminated pixel is formed in a plane in front of the eye. The virtual image is positioned on a straight line passing through the locus, the plane, and the pupil position. In this manner, the virtual image tracks change in the user's pupil position.

Stereoscopic display responsive to focal-point shift

A computing device includes a location sensor system including sensor(s) configured to measure one or more parameters of a surrounding environment, a pose-tracking engine configured to determine a current pose of the computing device based on the one or more measured parameters of the surrounding environment, a graphing engine configured to access a traversability graph including a plurality of vertices each having a local coordinate system, a navigation engine configured to identify a nearby vertex of the traversability graph to the current pose, and configured to determine a path of traversable edges between the nearby vertex and a destination vertex of the traversability graph, and a display configured to visually present as an overlay to the environment a navigation visualization corresponding to the path.

Augmented reality navigation

Growing community of inventors

Seattle, WA, United States of America

Tony Ambrus