Microsoft Technology Licensing, LLC

Kevin Geisner

Stephen G Latta

Relja Markovic

Darren Bennett

Daniel Joseph McCulloch

Ryan Lucas Hastings

Brian James Mount

Kathryn Stone Perez

Ben J Sugden

Gregory Nelson Snook

Jason Bradley Scott

Jonathan Steed

Arthur Charles Tomlin

Alex Aben-Athar Kipman

John Clavin

Brian Murphy

Shawn Crispin Wright

Benjamin Isaac Vaught

Kudo Tsunoda

Michael Scavezze

Christopher Harley Willoughby

Mike Scavezze

Joel Deaguero

Robert L Crocco, Jr

Wei Zhang

Ian Douglas McIntyre

Steven Nabil Bathiche

Jeffrey Neil Margolis

Alex A Kipman

Aaron Daniel Krauss

Kyungsuk David Lee

Ben Vaught

Johnny Hsienchow Lee

Vivek Pradeep

Jeffrey Jesus Evertt

Sheridan Martin Small

Darren Alexander Bennett

Sebastian Sylvan

Christopher Vuchetich

Oscar Omar Garza Santos

Mark Mihelich

Phillip Charles Heckinger

Pedro Perez

Matt Coohill

Kenneth Paul Hinckley

Hrvoje Benko

Andrew John Fuller

Mark James Finocchio

Adam G Poulos

Cameron Graeme Brown

Alice Jane Bernheim Brush

Jeffrey Alan Kohler

Tony Ambrus

Adam Jethro Langridge

Amos Dylan Vance

David M Hill

Daniel Lee Osborn

David C Haley, Jr

Peter Glenn Sarrett

Dylan Vance

David Galloway

A Dylan Vance

Desney S Tan

Chee Heng Chew

Derek L Knee

Alexandru Octavian Balan

Anthony James Ambrus

Mathew Julian Lamb

Brian E Keane

Andrew Royal

Jeffrey Cole

Christopher E Miles

Martin J Sleeman

Justin Avram Clark

Britta Silke Hummel

David Seymour

Adam Benjamin Smith-Kipnis

Roger Sebastian Kevin Sylvan

Holly A Hirzel

William Axel Olsen

Robert Crocco

William Paul Giese

Justin McBride

Arnulfo Zepeda Navratil

Matthew James Searcy

Darrin Adam Brown

Matthew Monson

Michael A Spalding

Rob SanFilippo

Arnulfo Zepeda

David Jason Christopher Horbach

Matthew Jon Puls

Relia Markovic

Adam Jethro Lanygridge

Greg Snook

Kathryn Stonw Perez

Rhett Mathis

David Gierok

Cam McRae

Stephen Gilchrist Latta

A method, medium, and virtual object for providing a virtual representation with an attribute are described. The virtual representation is generated based on a digitization of a real-world object. Properties of the virtual representation, such as colors, shape similarities, volume, surface area, and the like are identified and an amount or degree of exhibition of those properties by the virtual representation is determined. The properties are employed to identify attributes associated with the virtual representation, such as temperature, weight, or sharpness of an edge, among other attributes of the virtual object. A degree of exhibition of the attributes is also determined based on the properties and their degrees of exhibition. Thereby, the virtual representation is provided with one or more attributes that instruct presentation and interactions of the virtual representation in a virtual world.

Adding attributes to virtual representations of real-world objects

Systems, methods and computer readable media are disclosed for gesture input beyond skeletal. A user's movement or body position is captured by a capture device of a system. Further, non-user-position data is received by the system, such as controller input by the user, an item that the user is wearing, a prop under the control of the user, or a second user's movement or body position. The system incorporates both the user-position data and the non-user-position data to determine one or more inputs the user made to the system.

Combining gestures beyond skeletal

Embodiments that relate to interacting with a physical object in a mixed reality environment via a head-mounted display are disclosed. In one embodiment a mixed reality interaction program identifies an object based on an image from captured by the display. An interaction context for the object is determined based on an aspect of the mixed reality environment. A profile for the physical object is queried to determine interaction modes for the object. A selected interaction mode is programmatically selected based on the interaction context. A user input directed at the object is received via the display and interpreted to correspond to a virtual action based on the selected interaction mode. The virtual action is executed with respect to a virtual object associated with the physical object to modify an appearance of the virtual object. The modified virtual object is then displayed via the display.

Mixed reality interactions

The technology provides contextual personal information by a mixed reality display device system being worn by a user. A user inputs person selection criteria, and the display system sends a request for data identifying at least one person in a location of the user who satisfy the person selection criteria to a cloud based application with access to user profile data for multiple users. Upon receiving data identifying the at least one person, the display system outputs data identifying the person if he or she is within the field of view. An identifier and a position indicator of the person in the location is output if not. Directional sensors on the display device may also be used for determining a position of the person. Cloud based executing software can identify and track the positions of people based on image and non-image data from display devices in the location.

Providing location occupancy analysis via a mixed reality device

A head-mounted display system includes a see-through display that is configured to visually augment an appearance of a physical environment to a user viewing the physical environment through the see-through display. Graphical content presented via the see-through display is created by modeling the ambient lighting conditions of the physical environment.

Virtual light in augmented reality

A system for generating a virtual gaming environment based on features identified within a real-world environment, and adapting the virtual gaming environment over time as the features identified within the real-world environment change is described. Utilizing the technology described, a person wearing a head-mounted display device (HMD) may walk around a real-world environment and play a virtual game that is adapted to that real-world environment. For example, the HMD may identify environmental features within a real-world environment such as five grassy areas and two cars, and then spawn virtual monsters based on the location and type of the environmental features identified. The location and type of the environmental features identified may vary depending on the particular real-world environment in which the HMD exists and therefore each virtual game may look different depending on the particular real-world environment.

Augmented reality spaces with adaptive rules

Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

Multi-input user authentication on display device

Systems, methods and computer readable media are disclosed for controlling perspective of a camera-controlled computer. A capture device captures user gestures and sends corresponding data to a recognizer engine. The recognizer engine analyzes the data with a plurality of filters, each filter corresponding to a gesture. Based on the output of those filters, a perspective control is determined, and a display device displays a new perspective corresponding to the perspective control.

Method to control perspective for a camera-controlled computer

Implementations for identifying, capturing, and presenting high-quality photo-representations of acts occurring during play of a game that employs motion tracking input technology are disclosed. As one example, a method is disclosed that includes capturing via an optical interface, a plurality of photographs of a player in a capture volume during play of the electronic game. The method further includes for each captured photograph of the plurality of captured photographs, comparing an event-based scoring parameter to an event depicted by or corresponding to the captured photograph. The method further includes assigning respective scores to the plurality of captured photographs based, at least in part, on the comparison to the even-based scoring parameter. The method further includes associating the captured photographs at an electronic storage media with the respective scores assigned to the captured photographs.

Intelligent gameplay photo capture

Embodiments for interacting with an executable virtual object associated with a real object are disclosed. In one example, a method for interacting with an executable virtual object associated with a real object includes receiving sensor input from one or more sensors attached to the portable see-through display device, and obtaining information regarding a location of the user based on the sensor input. The method also includes, if the location includes a real object comprising an associated executable virtual object, then determining an intent of the user to interact with the executable virtual object, and if the intent to interact is determined, then interacting with the executable object.

Executable virtual objects associated with real objects

In applications that display a representation of a user, it may be reasonable to insert a pre-canned animation rather than animating a user's captured motion. For example, in a tennis swing, the ball toss and take back in a serve could be a pre-canned animation, whereas the actual forward swing may be mapped from the user's gestures. An animation of a user's gestures can be chained together into sequences with pre-canned animations, where animation blending techniques can provide for a smoother transition between the animation types. Techniques for blending animations, that may comprise determining boundaries and transition points between pre-canned animations and animations based on captured motion, may improve animation efficiency. Gesture history, including joint position, velocity, and acceleration, can be used to determine user intent, seed parameters for subsequent animations and game control, and determine the subsequent gestures to initiate.

Chaining animations

Depth-image analysis is performed with a device that analyzes a human target within an observed scene by capturing depth-images that include depth information from the observed scene. The human target is modeled with a virtual skeleton including a plurality of joints. The virtual skeleton is used as an input for controlling a driving simulation.

Driving simulator control with virtual skeleton

Technology is described for resource management based on data including image data of a resource captured by at least one capture device of at least one personal audiovisual (A/V) apparatus including a near-eye, augmented reality (AR) display. A resource is automatically identified from image data captured by at least one capture device of at least one personal A/V apparatus and object reference data. A location in which the resource is situated and a 3D space position or volume of the resource in the location is tracked. A property of the resource is also determined from the image data and tracked. A function of a resource may also be stored for determining whether the resource is usable for a task. Responsive to notification criteria for the resource being satisfied, image data related to the resource is displayed on the near-eye AR display.

Personal audio/visual apparatus providing resource management

Growing community of inventors

Mercer Island, WA, United States of America

Kevin Geisner