Microsoft Technology Licensing, LLC

Jamie Bryant Kirschenbaum

Nicholas Ferianc Kamuda

Ramiro Torres

Cameron Graeme Brown

Nicholas Fajt

Stephen G Latta

Daniel Joseph McCulloch

Relja Markovic

Ben J Sugden

Julia Schwarz

Jason Bradley Scott

Ryan Lucas Hastings

Alex A Kipman

Robert L Crocco, Jr

Laura K Massey

Peter Tobias Kinnebrew

Brian E Keane

Michael Scavezze

Casey Leon Meekhof

Tony Ambrus

Sheng Kai Tang

Daniel Deptford

Thomas Matthew Gable

Nahil Tawfik Sharkasi

John Bevis

Thomas Salter

Michael Klucher

Zachary Quarles

Sophie Stellmach

Jason Michael Ray

Kevin John Appel

Joshua Kyle Neff

Mike Thomas

Chuan Qin

Neil Richard Kronlage

Jack Daniel Caron

John Scott Iverson

Ramiro S Torres

A head-mounted display comprises a display device and an outward-facing depth camera. A storage machine comprises instructions executable by a logic machine to present one or more virtual objects on the display device, to receive information from the depth camera about an environment, and to determine a position of the head-mounted display within the environment. Based on the position of the head-mounted display, a position of a joint of a user's arm is inferred. Based on the information received from the depth camera, a position of a user's hand is determined. A ray is cast from a portion of the user's hand based on the position of the joint of the user's arm and the position of the user's hand. Responsive to the ray intersecting with one or more control points of a virtual object, the user is provided with an indication that the virtual object is being targeted.

Holographic palm raycasting for targeting virtual objects

A method for augmenting a two-stage hand gesture input comprises receiving hand tracking data for a hand of a user. A gesture recognition machine recognizes that the user has performed a first-stage gesture based on one or more parameters derived from the received hand tracking data satisfying first-stage gesture criteria. An affordance cueing a second-stage gesture is provided to the user responsive to recognizing the first-stage gesture. The gesture recognition machine recognizes that the user has performed the second-stage gesture based on one or more parameters derived from the received hand tracking data satisfying second-stage gesture criteria. A graphical user interface element is displayed responsive to recognizing the second-stage gesture.

Augmented two-stage hand gesture input

A head-mounted display system is provided, including a head-mounted display, an imaging sensor, and a processor. The processor may convey instructions to the head-mounted display to display a virtual object at a world-locked location in a physical environment. The processor may receive imaging data of the physical environment from the imaging sensor. The processor may determine, based on the imaging data, that a world-space distance between a hand of a user and the world-locked location is below a predetermined distance threshold. The processor may convey instructions to the head-mounted display to display a bounding virtual object that covers at least a portion of the virtual object. The processor may detect, based on the imaging data, a change in the world-space distance. The processor may convey instructions to the head-mounted display to modify a visual appearance of the bounding virtual object based on the change in the world-space distance.

Bounding virtual object

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.

Indicating out-of-view augmented reality images

Methods for generating virtual proxy objects and controlling the location of the virtual proxy objects within an augmented reality environment are described. In some embodiments, a head-mounted display device (HMD) may identify a real-world object for which to generate a virtual proxy object, generate the virtual proxy object corresponding with the real-world object, and display the virtual proxy object using the HMD such that the virtual proxy object is perceived to exist within an augmented reality environment displayed to an end user of the HMD. In some cases, image processing techniques may be applied to depth images derived from a depth camera embedded within the HMD in order to identify boundary points for the real-world object and to determine the dimensions of the virtual proxy object corresponding with the real-world object.

Virtual representations of real-world objects

Growing community of inventors

Sammamish, WA, United States of America

Jamie Bryant Kirschenbaum