Microsoft Technology Licensing, LLC

Arthur Charles Tomlin

Stephen G Latta

Brian James Mount

Daniel Joseph McCulloch

Adam G Poulos

Kevin Geisner

Ryan Lucas Hastings

Jason Bradley Scott

Cameron Graeme Brown

Darren Bennett

Aaron Daniel Krauss

Relja Markovic

Tony Ambrus

Evan Michael Keibler

Jonathan Steed

Nicholas Fajt

Wei Zhang

Ben J Sugden

Anthony James Ambrus

Kathryn Stone Perez

Jeffrey Alan Kohler

John Clavin

Gregory Nelson Snook

Michael Scavezze

Adolfo Hernandez Santisteban

Dan B Kroymann

Jeffrey Sipko

Jonathan Gustav Paulovich

Mike Scavezze

Jonathan Plumb

Andrew Frederick Muehlhausen

Kendall Clark York

Gregory Alt

Georg Klein

Sebastian Sylvan

Ben Vaught

Ashraf A Michail

Martin Thomas Shetter

Matthew Kaplan

Christopher Douglas Edmonds

Zhiwei Li

Jeffrey Neil Margolis

Michael Isard

Robert L Crocco, Jr

Kathleen Patricia Mulcahy

Nathan Ackerman

Drew Edward Steedly

Frederik Schaffalitzky

Rui Cai

Mathew Julian Lamb

Brian Murphy

John Benjamin Hesketh

Donna Katherine Long

Jeffrey Cole

Paul Ronald Barham

Ian Douglas McIntyre

Constantin Dulu

Justin Avram Clark

Andrew Martin Pearson

James Dack

Eric Scott Rehmeyer

Roger Sebastian Sylvan

Kevin Woo

Calvin Chan

Cheyne Rory Quin Mathey-Owens

Michael Jason Gourlay

Mike Thomas

Jeremy Lee

Alex Aben-Athar Kipman

Nicolas A Denhez

Ethan Eade

Alex A Kipman

Alexandru Octavian Balan

Benjamin Isaac Vaught

Robert Thomas Held

Christian Michael Sadak

Lorenz Henric Jentz

Benjamin Hunter Boesel

Kenneth Liam Kiemele

Michael Robert Thomas

Lev Cherkashin

Michael Edward Samples

Kyungsuk David Lee

Michael Grabner

Matthew Sammis Ashman

Andrew Austin Jackson

Marcus Philip Ghaly

Lewey Geselowitz

Matthew Calbraith Crisler

Mario Emmanuel Maltezos

Jonathan Lyons

Priya Ganadas

Timothy David Kviz

Roger Sebastian Kevin Sylvan

Nikolai Michael Faaland

Christopher Vuchetich

Erik Andrew Saltwell

Varun Ramesh Mani

Phillip Charles Heckinger

Peter Glenn Sarrett

A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Environmental condition based spatial audio presentation

A computing device is provided, which includes an input device, a display device, and a processor configured to, at a rendering stage of a rendering pipeline, render visual scene data to a frame buffer, and generate a signed distance field of edges of vector graphic data, and, at a reprojection stage of the rendering pipeline prior to displaying the rendered visual scene, receive post rendering user input via the input device that updates the user perspective, reproject the rendered visual scene data in the frame buffer based on the updated user perspective, reproject data of the signed distance field based on an updated user perspective, evaluate the signed distance field to generate reprojected vector graphic data, and generate a composite image including the reprojected rendered visual scene data and the reprojected graphic data, and display the composite image on the display device.

Sharp text rendering with reprojection

A computing system is provided, including a first display device having a first hardware configuration including a first display and a second display device having a second hardware configuration different from the first hardware configuration and including a second display. The computing system may further include a processor configured to receive an input including instructions to launch an application program on the first display device. The application program may include application program hardware specifications indicating hardware used by the application program. Based on the first hardware configuration, the second hardware configuration, and the application program hardware specifications, the processor may be further configured to determine that the second hardware configuration matches the application program hardware specifications more closely than the first hardware configuration. The processor may be further configured to launch the application program on the second display device.

Display device selection based on hardware configuration

Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Collaborative mapping of a space using ultrasonic sonar

Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

Constructing augmented reality environment with pre-computed lighting

Technology is described for (3D) space carving of a user environment based on movement through the user environment of one or more users wearing a near-eye display (NED) system. One or more sensors of the NED system provide sensor data from which a distance and direction of movement can be determined. Spatial dimensions for a navigable path can be represented based on user height data and user width data of the one or more users who have traversed the path. Space carving data identifying carved out space can be stored in a 3D space carving model of the user environment. The navigable paths can also be related to position data in another kind of 3D mapping like a 3D surface reconstruction mesh model of the user environment generated from depth images.

Space carving based on human physical data

A system and method are disclosed for displaying virtual content. When a user is settled in a given geographic area, a full version of the content may be displayed at user-defined or processor-defined location. When the user is moving, for example leaving the geographic area, a mobile version of the content may be displayed at a body-locked position peripheral to the user's view.

User-based context sensitive hologram reaction

The present disclosure provides apparatus and methods for automated tracking and counting of objects in a set of image frames using a resource-constrained device based on analysis of a selected subset of image frames, and based on selectively timing when resource-intensive operations are performed.

Apparatus and methods of automated tracking and counting of objects on a resource-constrained device

Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Synchronized spatial audio presentation

Various embodiments relating to detecting at least one of conversation, the presence and the identity of others during presentation of digital content on a computing device. When another person is detected, one or more actions may be taken with respect to the digital content. For example, the digital content may be minimized, moved, resized or otherwise modified.

Conversation, presence and context detection for hologram suppression

Sensor fusion is utilized in an electronic device such as a head mounted display (HMD) device that has a sensor package equipped with different sensors so that information that is supplemental to captured 2D images of objects or scenes in a real world environment may be utilized to determine an optimized transform of image stereo-pairs and to discard erroneous data that would otherwise prevent successful scans used for construction of a 3D model in, for example, virtual world applications. Such supplemental information can include one or more of world location, world rotation, image data from an extended field of view (FOV), or depth map data.

Optimized object scanning using sensor fusion

The disclosed technology provides multi-dimensional audio output by providing a relative physical location of an audio transmitting device relative to an audio outputting device in a shared map of physical space shared between the audio transmitting device and the audio outputting device. An orientation of the audio outputting device relative to the audio transmitting device is determined and an audio signal received from the audio transmitting device via a communication network is processed using the determined orientation of the audio outputting device relative to the audio transmitting device and the relative physical location of the audio transmitting device to create an augmented audio signal. The augmented audio signal is output through at least one audio output on the audio outputting device in a manner indicating a relative physical direction of the audio transmitting device to the audio outputting device in the shared map of the physical space.

Remote multi-dimensional audio

In embodiments of a camera-based input device, the input device includes an inertial measurement unit that collects motion data associated with velocity and acceleration of the input device in an environment, such as in three-dimensional (3D) space. The input device also includes at least two visual light cameras that capture images of the environment. A positioning application is implemented to receive the motion data from the inertial measurement unit, and receive the images of the environment from the at least two visual light cameras. The positioning application can then determine positions of the input device based on the motion data and the images correlated with a map of the environment, and track a motion of the input device in the environment based on the determined positions of the input device.

Position-determining input device

Various embodiments relating to detecting a conversation during presentation of content on a computing device, and taking one or more actions in response to detecting the conversation, are disclosed. In one example, an audio data stream is received from one or more sensors, a conversation between a first user and a second user is detected based on the audio data stream, and presentation of a digital content item is modified by the computing device in response to detecting the conversation.

Conversation detection

Growing community of inventors

Kirkland, WA, United States of America

Arthur Charles Tomlin