Microsoft Technology Licensing, LLC

Jeffrey Sipko

Kendall Clark York

Adolfo Hernandez Santisteban

John Benjamin Hesketh

Arthur Charles Tomlin

Aaron Daniel Krauss

Christian Michael Sadak

Kenneth Liam Kiemele

Andrew Frederick Muehlhausen

Bryant Daniel Hawthorne

Roger Sebastian Sylvan

Donna Katherine Long

Charlene Mary Jeune

Stephen G Latta

Christian Klein

Alexandre Da Veiga

Hubert Van Hoof

Janet Lynn Schneider

Aaron Burns

Gregg Robert Wygonik

Michael Robert Thomas

Mario Emmanuel Maltezos

Sophors Khut

Priya Ganadas

Anthony Ernst

Ricardo Arturo Espinoza Reyes

Andrew Austin Jackson

Timothy David Kviz

Ishac Bertran

A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Environmental condition based spatial audio presentation

A computing system is provided, including a first display device having a first hardware configuration including a first display and a second display device having a second hardware configuration different from the first hardware configuration and including a second display. The computing system may further include a processor configured to receive an input including instructions to launch an application program on the first display device. The application program may include application program hardware specifications indicating hardware used by the application program. Based on the first hardware configuration, the second hardware configuration, and the application program hardware specifications, the processor may be further configured to determine that the second hardware configuration matches the application program hardware specifications more closely than the first hardware configuration. The processor may be further configured to launch the application program on the second display device.

Display device selection based on hardware configuration

Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Collaborative mapping of a space using ultrasonic sonar

A wearable device is configured with a one-dimensional depth sensor (e.g., a LIDAR system) that scans a physical environment, in which the wearable device and depth sensor generate a point cloud structure using scanned points of the physical environment to develop blueprints for a negative space of the environment. The negative space includes permanent structures (e.g., walls and floors), in which the blueprints distinguish permanent structures from temporary objects. The depth sensor is affixed in a static position on the wearable device and passively scans a room according to the gaze direction of the user. Over a period of days, weeks, months, or years the blueprint continues to supplement the point cloud structure and update points therein. Thus, as the user continues to navigate the physical environment, over time, the point cloud data structure develops an accurate blueprint of the environment.

Using a one-dimensional ray sensor to map an environment

Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Synchronized spatial audio presentation

The disclosed technology provides multi-dimensional audio output by providing a relative physical location of an audio transmitting device relative to an audio outputting device in a shared map of physical space shared between the audio transmitting device and the audio outputting device. An orientation of the audio outputting device relative to the audio transmitting device is determined and an audio signal received from the audio transmitting device via a communication network is processed using the determined orientation of the audio outputting device relative to the audio transmitting device and the relative physical location of the audio transmitting device to create an augmented audio signal. The augmented audio signal is output through at least one audio output on the audio outputting device in a manner indicating a relative physical direction of the audio transmitting device to the audio outputting device in the shared map of the physical space.

Remote multi-dimensional audio

Examples are disclosed that relate to devices and methods for sharing geo-located information between different devices. In one example, a method comprises receiving the geo-located information from a first user device having a first data type compatible with a first output component of the device, receiving first sensor data from the first device, determining a location of the geo-located information within a coordinate system in a physical environment, determining that a second user device is located in the physical environment, determining that the second device does not comprise an output component that is compatible with the first data type, transforming the geo-located information into a second data type compatible with a second output component of the second device, determining that the second device is proximate to the location of the geo-located information, and sending the geo-located information to the second device for output by the second output component.

Sharing geo-located information

Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Device having a screen region on a hinge coupled between other screen regions

A mobile computing device is provided that includes a processor, an accelerometer, two or more display devices, and a housing including the processor, the accelerometer, and the two or more display devices, determine a current user focus indicating that a first display device of the pair of display devices is being viewed by the user, and that a second display device of the pair of display devices is not being viewed by the user, detect a signature gesture input based on accelerometer data received via the accelerometer detecting that the mobile computing device has been rotated more than a threshold degree, determine that the current user focus has changed from the first display device to the second display device based on at least detecting the signature gesture input, and perform a predetermined action based on the current user focus.

Detecting user focus on hinged multi-screen device

A wearable device is configured with various sensory devices that recurrently monitor and gather data for a physical environment surrounding a user to help locate and track real-world objects. The various heterogeneous sensory devices digitize objects and the physical world. Each sensory device is configured with a threshold data change, in which, when the data picked up by one or more sensory devices surpasses the threshold, a query is performed on each sensor graph or sensory device. The queried sensor graph data is stored within a node in a spatial graph, in which nodes are connected to each other using edges to create spatial relationships between objects and spaces. Objects can be uploaded into an object graph associated with the spatial graph, in which the objects are digitized with each of the available sensors. This digital information can be subsequently used to, for example, locate the object.

Object and location tracking with a graph-of-graphs

To address issues of capturing and processing images, a mobile computing device is provided. The mobile computing device may include a two-part housing coupled by a hinge, with first and second parts that include first and second displays, respectively. The hinge may permit the displays to rotate throughout a plurality of angular orientations. The mobile computing device may include one or more sensor devices, processor, first camera, and second camera mounted in the housing. The one or more sensor devices may be configured to measure the relative angular displacement of the housing, and the processor may be configured to process images captured by the first and second cameras according to a selected function based upon the relative angular displacement measured by the one or more sensor devices.

Growing community of inventors

Kirkland, WA, United States of America

Jeffrey Sipko