Microsoft Technology Licensing, LLC

Michael Scavezze

Daniel Joseph McCulloch

Ryan Lucas Hastings

Stephen G Latta

Brian James Mount

Kevin Geisner

Jason Bradley Scott

Cameron Graeme Brown

Jonathan Steed

Arthur Charles Tomlin

Darren Bennett

Nicholas Fajt

Robert L Crocco, Jr

Tony Ambrus

John Bevis

Relja Markovic

Ben J Sugden

Adam G Poulos

Brian E Keane

Alex A Kipman

Nicholas Ferianc Kamuda

Laura K Massey

Peter Tobias Kinnebrew

Daniel Deptford

Thomas Salter

Jamie Bryant Kirschenbaum

Phillip Charles Heckinger

Zachary Quarles

Michael Klucher

Alex Aben-Athar Kipman

Zhiwei Li

Benjamin Isaac Vaught

Rui Cai

Aaron Daniel Krauss

Charlene Mary Jeune

Abby Lin Lee

Jeremy Lee

Ron Amador-Leon

Kathryn Stone Perez

Jeff D Smith

Derek L Knee

Alexandru Octavian Balan

Anthony James Ambrus

Mathew Julian Lamb

Aaron Burns

Gerhard A Schneider

Quentin Simon Charles Miller

Michael Robert Thomas

Scott Robert Ramsby

Christopher E Miles

Ian Douglas McIntyre

Andrew Austin Jackson

Marcus Philip Ghaly

Roger Sebastian Sylvan

Matthew Kaplan

Cheyne Rory Quin Mathey-Owens

Katelyn Doran

Mike Thomas

Jeffrey David Smith

Holly A Hirzel

Richard Wifall

Arnulfo Zepeda Navratil

Ronald Amador-Leon

Megan Ann Lindsay

Johanna Dy Lynn

Russ McMackin

Johnathan Robert Bevis

Nicholas Gervase Fajt

Aaron Mackay Burns

Daniel Mcculloch

Michael Thomas

Matthew G Kaplan

Scott Ramsby

Russ Mcmackin

Katelyn Elizabeth Doran

Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

Optimized object scanning using sensor fusion

Embodiments are disclosed herein that relate to tuning gesture recognition characteristics for a device configured to receive gesture-based user inputs. For example, one disclosed embodiment provides a head-mounted display device including a plurality of sensors, a display configured to present a user interface, a logic machine, and a storage machine that holds instructions executable by the logic machine to detect a gesture based upon information received from a first sensor of the plurality of sensors, perform an action in response to detecting the gesture, and determine whether the gesture matches an intended gesture input. The instructions are further executable to update a gesture parameter that defines the intended gesture input if it is determined that the gesture detected does not match the intended gesture input.

Gesture parameter tuning

Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Mixed reality interactions

A method includes determining a current pose of an augmented reality device in a physical space, and visually presenting, via a display of the augmented reality device, an augmented-reality view of the physical space including a predetermined pose cue indicating a predetermined pose in the physical space and a current pose cue indicating the current pose in the physical space.

Virtual cues for augmented-reality pose alignment

Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Displaying three-dimensional virtual objects based on field of view

A system for generating a virtual gaming environment based on features identified within a real-world environment, and adapting the virtual gaming environment over time as the features identified within the real-world environment change is described. Utilizing the technology described, a person wearing a head-mounted display device (HMD) may walk around a real-world environment and play a virtual game that is adapted to that real-world environment. For example, the HMD may identify environmental features within a real-world environment such as five grassy areas and two cars, and then spawn virtual monsters based on the location and type of the environmental features identified. The location and type of the environmental features identified may vary depending on the particular real-world environment in which the HMD exists and therefore each virtual game may look different depending on the particular real-world environment.

Augmented reality spaces with adaptive rules

Disclosed are techniques for performing undo operations on holographic objects in an immersive 3D visual environment. A display system allows the user to undo a given user operation performed on a particular selected holographic object without affecting any other holographic objects, based on a user's gaze and/or other user input. The technique can be implemented in conjunction with a scrollable visual 'timeline' in which multiple past states of the display environment are displayed to the user and are selectable by the user as the target state of the revert operation. Also disclosed is a technique for partially undoing a single continuous user action in a holographic display system.

Holographic display system with undo functionality

Various embodiments relating to selection of a user interface object displayed on a graphical user interface based on eye gaze are disclosed. In one embodiment, a selection input may be received. A plurality of eye gaze samples at different times within a time window may be evaluated. The time window may be selected based on a time at which the selection input is detected. A user interface object may be selected based on the plurality of eye gaze samples.

Selection using eye gaze evaluation over time

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Indicating out-of-view augmented reality images

Various embodiments relating to creating a virtual shadow of an object in an image displayed with a see-through display are provided. In one embodiment, an image of a virtual object may be displayed with the see-through display. The virtual object may appear in front of a real-world background when viewed through the see-through display. A relative brightness of the real-world background around a virtual shadow of the virtual object may be increased when viewed through the see-through display. The virtual shadow may appear to result from a spotlight that is fixed relative to a vantage point of the see-through display.

Mixed reality spotlight

Augmented reality playspaces with adaptive game rules

Growing community of inventors

Bellevue, WA, United States of America

Michael Scavezze