Microsoft Technology Licensing, LLC

Aaron Daniel Krauss

Stephen G Latta

Jonathan Steed

Mike Scavezze

Arthur Charles Tomlin

Daniel Joseph McCulloch

Brian James Mount

Adolfo Hernandez Santisteban

Jason Bradley Scott

Jeffrey Sipko

Andrew Frederick Muehlhausen

Ian Douglas McIntyre

Ryan Lucas Hastings

Tony Ambrus

Kevin Geisner

Wei Zhang

Kendall Clark York

Priya Ganadas

Cameron Graeme Brown

Michael Robert Thomas

Adam G Poulos

Michael Scavezze

Kenneth Liam Kiemele

Donna Katherine Long

Ben J Sugden

Alexandre Da Veiga

Aaron Burns

Christian Michael Sadak

Jonathan Gustav Paulovich

Bryant Daniel Hawthorne

Marcus Philip Ghaly

Michelle Tze Hiang Chua

Roger Sebastian Sylvan

Charlene Mary Jeune

Jamie R Cabaccang

Evan Lewis Jones

Cheyne Rory Quin Mathey-Owens

Jeffrey David Smith

Richard Wifall

Jennifer Jean Choi

Ishac Bertran

Megan Ann Lindsay

Arnulfo Zepeda

Anthony Robert Menard

James Michael Ratliff

Daniel Mcculloch

Michael Thomas

Stephen Gilchrist Latta

A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Environmental condition based spatial audio presentation

Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Collaborative mapping of a space using ultrasonic sonar

Embodiments related to efficiently constructing an augmented reality environment with global illumination effects are disclosed. For example, one disclosed embodiment provides a method of displaying an augmented reality image via a display device. The method includes receiving image data, the image data capturing an image of a local environment of the display device, and identifying a physical feature of the local environment via the image data. The method further includes constructing an augmented reality image of a virtual structure for display over the physical feature in spatial registration with the physical feature from a viewpoint of a user, the augmented reality image comprising a plurality of modular virtual structure segments arranged in adjacent locations to form the virtual structure feature, each modular virtual structure segment comprising a pre-computed global illumination effect, and outputting the augmented reality image to the display device.

Constructing augmented reality environment with pre-computed lighting

Examples are disclosed herein that relate to receiving virtual reality input. An example provides a head-mounted display device comprising a sensor system, a display, a logic machine, and a storage machine holding instructions executable by the logic machine. The instructions are executable to execute a 3D virtual reality experience on the head-mounted display device, track, via the sensor system, a touch-sensitive input device, render, on the display, in a 3D location in the 3D virtual reality experience based on the tracking of the touch-sensitive input device, a user interface, receive, via a touch sensor of the touch-sensitive input device, a user input, and, in response to receiving the user input, control the 3D virtual reality experience to thereby vary visual content being rendered on the display.

Virtual reality input

A computer device is provided that includes an input device, a sensor device, a display device, and a processor. The processor is configured to detect a physical object in a physical environment based on sensor data received via the sensor device, measure one or more physical parameters of the physical object based on the sensor data, determine a physical behavior of the physical object based on the measured one or more physical parameters, present a graphical representation of the physical behavior of the physical object via the display device, generate a simulation of the physical behavior of the physical object based on the measured one or more physical parameters, receive a user input to modify the one or more physical parameters for the simulation via the input device, and present the simulation with the modified one or more physical parameters via the display device.

Modifiable simulation of physical object behavior

Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Remembering audio traces of physical actions

Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Synchronized spatial audio presentation

The disclosed technology provides multi-dimensional audio output by providing a relative physical location of an audio transmitting device relative to an audio outputting device in a shared map of physical space shared between the audio transmitting device and the audio outputting device. An orientation of the audio outputting device relative to the audio transmitting device is determined and an audio signal received from the audio transmitting device via a communication network is processed using the determined orientation of the audio outputting device relative to the audio transmitting device and the relative physical location of the audio transmitting device to create an augmented audio signal. The augmented audio signal is output through at least one audio output on the audio outputting device in a manner indicating a relative physical direction of the audio transmitting device to the audio outputting device in the shared map of the physical space.

Remote multi-dimensional audio

A computing system is provided, including a plurality of display devices including at least a first display device and a second display device. The computing system may further include one or more sensors configured to detect a first positional state of the first display device relative to the second display device and at least one user. The first positional state may include an angular orientation of the first display device relative to the second display device. The computing system may further include a processor configured to receive the first positional state from the one or more sensors. The processor may be further configured to generate first graphical content based at least in part on the first positional state. The processor may be further configured to transmit the first graphical content for display at the first display device.

Displaying content based on positional state

A computer system is provided that includes one or more processors configured to receive a stream of data from a plurality of network connected devices configured to measure physical parameters, and store a user profile including user settings for a plurality of notification subscriptions associated with physical parameters measured by the plurality of network connected devices. Each notification subscription includes programming logic for a trigger condition for a candidate notification based on measured physical parameters and an associated component sound for the candidate notification. The one or more processors are further configured to determine that trigger conditions for a plurality of candidate notifications are met based on the received stream of data, and generate a composite sound output including a plurality of component sounds associated with the plurality of notifications rendered.

Composite sound output for network connected devices

Examples disclosed relate to displaying virtual objects. One example provides, on a display device comprising a camera and a display, a method comprising acquiring, via the camera, image data imaging an environment, receiving a user input requesting display of a three-dimensional virtual object, comparing dimensional information for the three-dimensional virtual object to dimensional information for a field of view of the display device, modifying the three-dimensional virtual object based upon comparing the dimensional information for the three-dimensional virtual object to the dimensional information for the field of view to obtain a modified three-dimensional virtual object, and displaying the modified three-dimensional virtual object via the display.

Displaying three-dimensional virtual objects based on field of view

Embodiments are disclosed that relate to authenticating a user of a display device. For example, one disclosed embodiment includes displaying one or more virtual images on the display device, wherein the one or more virtual images include a set of augmented reality features. The method further includes identifying one or more movements of the user via data received from a sensor of the display device, and comparing the identified movements of the user to a predefined set of authentication information for the user that links user authentication to a predefined order of the augmented reality features. If the identified movements indicate that the user selected the augmented reality features in the predefined order, then the user is authenticated, and if the identified movements indicate that the user did not select the augmented reality features in the predefined order, then the user is not authenticated.

Multi-input user authentication on display device

Embodiments are disclosed herein that relate to the automatic tracking of objects. For example, one disclosed embodiment provides a method of operating a mobile computing device having an image sensor. The method includes acquiring image data, identifying an inanimate moveable object in the image data, determining whether the inanimate moveable object is a tracked object, if the inanimate moveable object is a tracked object, then storing information regarding a state of the inanimate moveable object, detecting a trigger to provide a notification of the state of the inanimate moveable object, and providing an output of the notification of the state of the inanimate moveable object.

Object tracking

Growing community of inventors

Snoqualmie, WA, United States of America

Aaron Daniel Krauss