Microsoft Technology Licensing, LLC

Anthony James Ambrus

Jeffrey Alan Kohler

Brian James Mount

Shawn Crispin Wright

Daniel Joseph McCulloch

Arthur Charles Tomlin

Adam G Poulos

Mathew Julian Lamb

Austin Seungmin Lee

James Dack

Korey Krauskopf

Keiichi Matsuda

Michael W McManus

Jason Bradley Scott

Dan B Kroymann

Sophie Stellmach

Amy Mun Hong

Alexander James Hogan

Cameron Graeme Brown

Nicholas Fajt

Michael Edward Samples

Sheng Kai Tang

Kyungsuk David Lee

Justin Avram Clark

Todd Omotani

Nahil Tawfik Sharkasi

Eric Scott Rehmeyer

David C Haley, Jr

Daniel Lee Osborn

Kenneth Mitchell Jakubzak

Albert Robles

Craig Hoffman

Michael Jason Gourlay

Dave Hill

Roger Sebastian-Kevin Sylvan

Andrew R Campbell

Jonathan Palmer

Andrew Zibits

Edward Daniel Parker

Cameron Quinn Egbert

Jea Gon Park

Andrew David Wilson

Christopher Douglas Edmonds

Kevin Geisner

Nicolas A Denhez

Darren Bennett

Alexandru Octavian Balan

Scott Fullam

Jonathan Steed

Sergio Paolantonio

Michael Scavezze

Anatolie Gavriliuc

Benjamin Hunter Boesel

Lorenz Henric Jentz

Wei Zhang

Quentin Simon Charles Miller

Lev Cherkashin

Michael Robert Thomas

Constantin Dulu

Gregory Alt

Michael Grabner

Evan Michael Keibler

Marcus Philip Ghaly

John Bevis

Jordan Dale Andersen

Lewey Geselowitz

Jonathan Lyons

Erik Andrew Saltwell

Benjamin Markus Thaut

Varun Ramesh Mani

Muhammad Jabir Kapasi

Jeffrey Wallace McGlynn

Abdulwajid N Mohamed

Brent Charles Allen

Jon Paulovich

Will Guyman

Jorge Tosar

Cecilia Bong

Miguel Angel Susffalich

Mike Boulton

Michael Ey

Jeff W McGlynn

Jeremy Hance

Alexander Georg Pfaffe

Chris Word

Aleksandar Josic

Logan James Buesching

Jeffrey Wallace Mcglynn

Michael Thomas

Daniel J Mcculloch

A computer implemented method includes detecting user interaction with mixed reality displayed content in a mixed reality system. User focus is determined as a function of the user interaction based on the user interaction using a spatial intent model. A length of time for extending voice engagement with the mixed reality system is modified based on the determined user focus. Detecting user interaction with the displayed content may include tracking eye movements to determine objects in the displayed content at which the user is looking and determining a context of a user dialog during the voice engagement.

Spatial attention model enhanced voice engagement system

Systems and methods are provided for facilitating the presentation of expressive intent and other status information with messaging and other communication applications. The expressive intent is based on expressive effect data associated with the message recipients and/or message senders. The expressive intent can be conveyed through avatars and modified message content. The avatars convey gestures, emotions and other status information and the presentation of the avatars can be reactive to detected state information of the message recipient(s), message sender(s) and/or corresponding messaging device(s).

Modifying an avatar to reflect a user's expression in a messaging platform

Examples are disclosed that relate to image reprojection. One example provides a method, comprising receiving a first rendered image comprising content associated with a viewer reference frame, receiving a second rendered image comprising content associated with a manipulator reference frame, and reprojecting the first rendered image based on a head pose of a user to thereby produce a first reprojected image. The method further comprises reprojecting the second rendered image based on the head pose of the user and a pose of the manipulator to thereby produce a second reprojected image, and outputting the first reprojected image and the second reprojected image for display as a composited image.

Manipulator-based image reprojection

This disclosure relates to displaying a user interface for a computing device based upon a user intent determined via a spatial intent model. One example provides a computing device comprising a see-through display, a logic subsystem, and a storage subsystem. The storage subsystem comprises instructions executable by the logic machine to receive, via an eye-tracking sensor, eye tracking samples each corresponding to a gaze direction of a user, based at least on the eye tracking samples, determine a time-dependent attention value for a location in a field of view of the see-through display, based at least on the time-dependent attention value for the location, determine an intent of the user to interact with a user interface associated with the location that is at least partially hidden from a current view, and in response to determining the intent, display via the see-through display the user interface.

Determining user intent based on attention values

Rapid writing to and reading from even very large amounts of data, especially where the data evolves more slowly over time. For each of a sequence of commits of the data, the data is represented by identifying pages of the data that have changed since a prior commit in the sequence of commits. A sparce file is formulate for the commit, and contains each of identified pages, and for each identified page a mapping of the identified to a page address of the identified page in the address range. The sparce file is then stored as associated with the corresponding commit. Thus, an ordered sequence of sparce files can be created and layered on top of a base file that represents the entire page address range. The sparce files may be quite small as there may be relatively few pages (or perhaps even no pages) that changed since the prior commit in the sequence of commits. Reads occur by creating a sparce in-memory object, and checking for each page at each sparce.

Layered memory mapped file technology

One example provides a computing device comprising instructions executable to receive information regarding one or more entities in the scene, to receive eye tracking a plurality of eye tracking samples, each eye tracking sample corresponding to a gaze direction of a user and, based at least on the eye tracking samples, determine a time-dependent attention value for each entity of the one or more entities at different locations in a use environment, the time-dependent attention value determined using a leaky integrator. The instructions are further executable to receive a user input indicating an intent to perform a location-dependent action, associate the user input to with a selected entity based at least upon the time-dependent attention value for each entity, and perform the location-dependent action based at least upon a location of the selected entity.

Location-based entity selection using gaze tracking

Examples are disclosed herein relating to displaying a virtual assistant. One example provides an augmented reality display device comprising a see-through display, a logic subsystem, and a storage subsystem storing instructions executable by the logic subsystem to display via the see-through display a virtual assistant associated with a location in a real-world environment, detect a change in a field of view of the see-through display, and when the virtual assistant is out of the field of view of the see-through display after the change in the field of view, display the virtual assistant in a virtual window on the see-through display.

Display of virtual assistant in augmented reality

One or more sensors of a virtual reality device track a pose of the virtual reality device. The virtual reality device requests a virtual image having a perspective corresponding to a future pose from a remote computer. After receiving the requested virtual image, the virtual reality device adjusts the virtual image to an adjusted virtual image having an updated perspective corresponding to an updated tracked pose of the virtual reality device. Then, a virtual reality display displays the adjusted virtual image.

Remote rendering for virtual images

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

Space carving based on human physical data

Examples disclosed herein relate to providing a location-based holographic experience. One example provides a head-mounted display device comprising a see-through display, one or more position sensors, a logic subsystem, and a storage subsystem comprising instructions executable by the logic subsystem to obtain data representing a plurality of holographic objects, acquire sensor data via the one or more position sensors to monitor a position of the head-mounted display device along a path of a holographic experience, detect that the position of the head-mounted display device meets a first position-based condition regarding a first holographic object, and display the first holographic object at a corresponding location for the first holographic object.

Location-based holographic experience

In various embodiments, methods and systems for rendering augmented reality objects based on user heights are provided. Height data of a user of an augmented reality device can be determined. The height data relates to a viewing perspective from an eye level of the user. Placement data for a first augmented reality object is generated based on the user height data. The first augmented reality object is rendered based on the user height data, and a second augmented reality object is excluded from rendering based on the user height data.

User-height-based rendering system for augmented reality objects

A head-mounted display (HMD) device may include an at least partially see-through display, one or more location sensors, a communication unit, and a processor. The HMD device may determine at least a location of the one or more location sensors in a physical environment. The communication unit may receive peer location data from at least one peer HMD device in the physical environment. The processor of the HMD device may determine a field of view of the HMD device, identify a display position at which the augmented reality image can be displayed and viewed in the physical environment by the HMD device and the at least one peer HMD device, and display the augmented reality image at the display position on the at least partially see-through display of the HMD device.

Identification of augmented reality image display position

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

Position-determining input device

Growing community of inventors

Seattle, WA, United States of America

Anthony James Ambrus