Microsoft Technology Licensing, LLC

Daniel Joseph McCulloch

Stephen G Latta

Brian James Mount

Ryan Lucas Hastings

Jason Bradley Scott

Kevin Geisner

Ben J Sugden

Darren Bennett

Arthur Charles Tomlin

Cameron Graeme Brown

Adam G Poulos

Michael Scavezze

Jonathan Steed

Kathryn Stone Perez

Ian Douglas McIntyre

Alex Aben-Athar Kipman

Aaron Daniel Krauss

Nicholas Fajt

Robert L Crocco, Jr

Mike Scavezze

Anthony James Ambrus

Wei Zhang

Relja Markovic

Benjamin Isaac Vaught

John Clavin

Tony Ambrus

John Bevis

Matthew Kaplan

Jeffrey Neil Margolis

Alex A Kipman

Brian E Keane

Kyungsuk David Lee

Ben Vaught

Sebastian Sylvan

Abby Lin Lee

Jeremy Lee

Michael J Patten

Shawn Crispin Wright

Alexandru Octavian Balan

Jeffrey Alan Kohler

Nicholas Ferianc Kamuda

Peter Tobias Kinnebrew

Laura K Massey

Dan B Kroymann

Sheridan Martin Small

Gregory Alt

Daniel Deptford

Evan Michael Keibler

Jamie Bryant Kirschenbaum

Thomas Salter

Jonathan Plumb

Jeff Cole

Phillip Charles Heckinger

Holly A Hirzel

Mike Thomas

Andrew John Fuller

Mark James Finocchio

Mathew Julian Lamb

Kudo Tsunoda

Justin Avram Clark

Nahil Tawfik Sharkasi

Daniel Lee Osborn

David C Haley, Jr

Adam Benjamin Smith-Kipnis

Albert Robles

Michael Jason Gourlay

Ron Amador-Leon

Christopher Douglas Edmonds

Rod G Fleck

Derek L Knee

Drew Edward Steedly

Frederik Schaffalitzky

Anatolie Gavriliuc

Jonathan Gustav Paulovich

Dan Osborn

Michael Edward Samples

Lev Cherkashin

Scott Robert Ramsby

Jeffrey Cole

Michael Robert Thomas

Constantin Dulu

Christopher E Miles

Britta Silke Hummel

Michael Grabner

James Dack

Forest Woodcroft Gouin

Jedd Perry

Megan Saunders

Marcus Philip Ghaly

Eric Scott Rehmeyer

Roger Sebastian Sylvan

Roger Sebastian Kevin Sylvan

Benjamin John Sugden

Marcus Tanner

Hendrik Mark Langerak

Varun Ramesh Mani

Michael Gordon Hale

Jack Clevenger

Jonathan R Christen

Robert Courtney Memmott

Techniques for sharing across environments are described. Generally, different types of input may be employed to share content, such as using a pen, a stylus, a finger, touchless gesture input, and so forth. According to various embodiments, content may be shared between devices in local proximity, and/or between devices that are remote from one another. In at least some embodiments, content is shared based on an identity of a sharing user and/or sharing device.

Sharing across environments

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

Space carving based on human physical data

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes receiving a user input selecting an object in a field of view of the see-through display system, determining a first group of commands currently operable based on one or more of an identification of the selected object and a state of the object, and presenting the first group of commands to a user. The method may further include receiving a command from the first group of commands, changing the state of the selected object from a first state to a second state in response to the command, determining a second group of commands based on the second state, where the second group of commands is different than the first group of commands, and presenting the second group of commands to the user.

Context-aware augmented reality object commands

Techniques for ink in an electronic document are described. According to various implementations, techniques described herein provide a rich set of tools which allow a user to markup an electronic document such as a web page, not only in static 2D where the user writes on top of a document, but in dynamic 3D. In addition, when adding 3D elements to an electronic document, the 3D elements are added based on awareness of the content of the electronic document and can adapt its content in relationship to the document.

Ink in an electronic document

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

Position-determining input device

Embodiments are disclosed herein that relate to tuning gesture recognition characteristics for a device configured to receive gesture-based user inputs. For example, one disclosed embodiment provides a head-mounted display device including a plurality of sensors, a display configured to present a user interface, a logic machine, and a storage machine that holds instructions executable by the logic machine to detect a gesture based upon information received from a first sensor of the plurality of sensors, perform an action in response to detecting the gesture, and determine whether the gesture matches an intended gesture input. The instructions are further executable to update a gesture parameter that defines the intended gesture input if it is determined that the gesture detected does not match the intended gesture input.

Gesture parameter tuning

Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Mixed reality interactions

A head-mounted display includes a see-through display and a virtual reality engine. The see-through display is configured to visually augment an appearance of a physical space to a user viewing the physical space through the see-through display. The virtual reality engine is configured to cause the see-through display to visually present a virtual monitor that appears to be integrated with the physical space to a user viewing the physical space through the see-through display.

Augmented reality virtual monitor

Embodiments are disclosed for transitioning views presented via a head-mounted display device. One example method for operating a head-mounted display device includes displaying a virtual model at a first position in a coordinate frame of the head-mounted display device, receiving sensor data from one or more sensors of the head-mounted display device, and determining a line of sight of the user that intersects the virtual model to identify a location the user is viewing. The example method further includes, responsive to a trigger, moving the virtual model to a second position in the coordinate frame of the head-mounted display device corresponding to the location the user is viewing and simultaneously scaling the virtual model.

Transitioning views of a virtual model

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors on the near-eye display (NED) system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

The technology provides contextual personal information by a mixed reality display device system being worn by a user. A user inputs person selection criteria, and the display system sends a request for data identifying at least one person in a location of the user who satisfy the person selection criteria to a cloud based application with access to user profile data for multiple users. Upon receiving data identifying the at least one person, the display system outputs data identifying the person if he or she is within the field of view. An identifier and a position indicator of the person in the location is output if not. Directional sensors on the display device may also be used for determining a position of the person. Cloud based executing software can identify and track the positions of people based on image and non-image data from display devices in the location.

Providing location occupancy analysis via a mixed reality device

A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Virtual light in augmented reality

A system for generating a virtual gaming environment based on features identified within a real-world environment, and adapting the virtual gaming environment over time as the features identified within the real-world environment change is described. Utilizing the technology described, a person wearing a head-mounted display device (HMD) may walk around a real-world environment and play a virtual game that is adapted to that real-world environment. For example, the HMD may identify environmental features within a real-world environment such as five grassy areas and two cars, and then spawn virtual monsters based on the location and type of the environmental features identified. The location and type of the environmental features identified may vary depending on the particular real-world environment in which the HMD exists and therefore each virtual game may look different depending on the particular real-world environment.

Augmented reality spaces with adaptive rules

Disclosed are techniques for performing undo operations on holographic objects in an immersive 3D visual environment. A display system allows the user to undo a given user operation performed on a particular selected holographic object without affecting any other holographic objects, based on a user's gaze and/or other user input. The technique can be implemented in conjunction with a scrollable visual 'timeline' in which multiple past states of the display environment are displayed to the user and are selectable by the user as the target state of the revert operation. Also disclosed is a technique for partially undoing a single continuous user action in a holographic display system.

Holographic display system with undo functionality

Growing community of inventors

Kirkland, WA, United States of America

Daniel Joseph McCulloch