Microsoft Technology Licensing, LLC

Adolfo Hernandez Santisteban

Christian Michael Sadak

Jeffrey Sipko

Andrew Frederick Muehlhausen

Aaron Daniel Krauss

Arthur Charles Tomlin

Brian E Keane

Donna Katherine Long

Bryant Daniel Hawthorne

Mario Emmanuel Maltezos

John Benjamin Hesketh

Kendall Clark York

Andrew Austin Jackson

Priya Ganadas

Kenneth Liam Kiemele

Timothy David Kviz

Scott Christopher Speirs

Jamie R Cabaccang

Charlene Mary Jeune

Matthew Steven Johnson

John Benjamin George Hesketh

Yevdokia K Mashak

Ishac Bertran

Donna K Long

Aaron M Burns

Jeffrey R Sipko

A wearable spatial audio device is provided. The wearable spatial audio device includes one or more audio speakers, one or more processors, and a storage machine holding instructions executable by the one or more processors. Map data is obtained for a real-world environment that includes one or more dynamic audio objects. A device-specific subset of audio tracks is obtained, and a device-specific spatialized audio mix of the device-specific subset of audio tracks that is based on the map data is obtained. An indication of a change in an environmental condition relative to one or more of the dynamic audio objects is received. The device-specific spatialized audio mix is adjusted based on the change in the environmental condition.

Environmental condition based spatial audio presentation

Methods and devices for providing a haptic responses to a haptic feedback device may include receiving, by an application providing a virtual environment executing on a computer device, physical movement input based at least on movement of the haptic feedback device that corresponds to a virtual movement interaction with a virtual object in the virtual environment. The methods and devices may include accessing a haptic signature associated with the virtual object. The methods and devices may include determining a haptic response based at least upon the haptic signature to identify the virtual object through the haptic response. The methods and devices may include transmitting the haptic response to the haptic feedback device.

Natural interactions with virtual objects and data through touch

A computing system is provided, including a first display device having a first hardware configuration including a first display and a second display device having a second hardware configuration different from the first hardware configuration and including a second display. The computing system may further include a processor configured to receive an input including instructions to launch an application program on the first display device. The application program may include application program hardware specifications indicating hardware used by the application program. Based on the first hardware configuration, the second hardware configuration, and the application program hardware specifications, the processor may be further configured to determine that the second hardware configuration matches the application program hardware specifications more closely than the first hardware configuration. The processor may be further configured to launch the application program on the second display device.

Display device selection based on hardware configuration

Generally, a scanning device performs a sonic scan of a space by generating an ultrasonic impulse and measuring reflected signals as raw audio data. Sonic scan data including raw audio data and an associated scan location is forwarded to a sonic mapping service, which generates and distributes a 3D map of the space called a sonic map. When multiple devices contribute, the map is a collaborative sonic map. The sonic mapping service is advantageously available as distributed computing service, and can detect acoustic characteristics of the space and/or attribute visual/audio features to elements of a 3D model based on a corresponding detected acoustic characteristic. Various implementations that utilize a sonic map, detected acoustic characteristics, an impacted visual map, and/or an impacted 3D object include mixed reality communications, automatic calibration, relocalization, visualizing materials, rendering 3D geometry, and the like.

Collaborative mapping of a space using ultrasonic sonar

Methods and devices for creating a sound log of activities may include receiving a detected sound from at least one sensor on a computer device. The methods and devices may include comparing the detected sound to a plurality of audio patterns stored in a sound database. The methods and devices may include identifying a sound event for the detected sound based at least upon the comparison of the detected sound to the plurality of audio patterns. The methods and devices may include identifying context information that provides a context for the sound event. The methods and devices may include updating a sound log with the sound event and the context information.

Remembering audio traces of physical actions

Embodiments relate to enabling a user of data-sharing applications executing on a computing device to indirectly exchange objects between the applications by adding objects from the applications to a journal application that manages a display area. The objects are displayed in the display area. The journal application collects metadata related to the objects and automatically curates lists of the objects according to the metadata. Curation of a list may involve moving objects into a list, merging objects, creating new objects out of content of existing objects, grouping objects according to a commonality thereof, etc. Machine learning services may be invoked to acquire additional metadata about the objects and to make curation decisions.

Polymorphic smart context-aware lists

Examples are disclosed relating to providing spatialized audio to multiple users. In one example, a computing device presents spatialized audio to multiple users within an environment via communicative connection to one or more wearable spatial audio output devices. For each communicatively connected wearable spatial audio output device, a user-specific subset of audio tracks is generated from a set of audio tracks for a dynamic audio object positioned within the environment based on one or more user-specific parameters. A location of the wearable spatial audio output device is determined relative to the dynamic audio object, and based upon this location, a device-specific spatialized audio mix is generated that includes the user-specific subset of audio tracks. The device-specific spatialized audio mixes are sent to the wearable spatial output devices, and playback of the device-specific spatialized audio mixes are synchronously initiated at each wearable spatial audio output device.

Synchronized spatial audio presentation

Examples are disclosed that relate to refining virtual mesh models through physical contacts. For example, a hand-mounted mobile device, such as a wearable glove, may be used to create and/or emphasize specific points within a virtual mesh model of a physical environment. An indication of physical contact of an interface of the mobile device with a physical object may be obtained via a touch sensor of the mobile device. A location and/or an orientation of the interface of the mobile device during the physical contact with the physical object may be identified based on sensor data obtained from one or more positioning sensors. Location data indicating the location may be stored in a data storage device from which the location data may be referenced. In an example, refinement of a virtual mesh model of a physical environment containing the physical object may be prioritized based on the location data.

Refining virtual mesh models through physical contacts

The disclosed technology provides multi-dimensional audio output by providing a relative physical location of an audio transmitting device relative to an audio outputting device in a shared map of physical space shared between the audio transmitting device and the audio outputting device. An orientation of the audio outputting device relative to the audio transmitting device is determined and an audio signal received from the audio transmitting device via a communication network is processed using the determined orientation of the audio outputting device relative to the audio transmitting device and the relative physical location of the audio transmitting device to create an augmented audio signal. The augmented audio signal is output through at least one audio output on the audio outputting device in a manner indicating a relative physical direction of the audio transmitting device to the audio outputting device in the shared map of the physical space.

Remote multi-dimensional audio

A server computing device is provided, including a processor configured to execute a bot server program. The processor may provide a dialog for a first bot of the bot server program, the dialog including at least one trigger condition for transmitting default audio data. The processor may receive an audio data update communication from a bot developer computing device. Based on the audio data update communication, the processor may replace the default audio data with updated audio data. The processor may establish a first communication channel between the first bot and a client computing device. The first communication channel may allow one or more communications to be transmitted between the first bot and the client computing device based on the dialog. The processor may transmit a first communication to the client computing device via the first communication channel. The first communication may include the updated audio data.

Bot audio date updating

To address issues of capturing and processing images, a mobile computing device is provided. The mobile computing device may include a two-part housing coupled by a hinge, with first and second parts that include first and second displays, respectively. The hinge may permit the displays to rotate throughout a plurality of angular orientations. The mobile computing device may include one or more sensor devices, processor, first camera, and second camera mounted in the housing. The one or more sensor devices may be configured to measure the relative angular displacement of the housing, and the processor may be configured to process images captured by the first and second cameras according to a selected function based upon the relative angular displacement measured by the one or more sensor devices.

Image capture using a hinged device with multiple cameras

A mobile computing device including a housing having a first part and a second part, the first part including a first display and a first forward facing camera, and the second part including a second display and a second forward facing camera, at least one speaker mounted in the housing, and a processor mounted in the housing and configured to display a first graphical user interface element having an associated first audio stream on the first display and to display a second graphical user interface element having an associated second audio stream on the second display, wherein the processor is configured to perform face detection on a first and a second image, adjust an audio setting based on a result of the face detection, and play the first and second audio streams out of the at least one speaker based on the adjusted audio setting.

Volume adjustment on hinged multi-screen device

An electronic device includes memory associating a control action with a defined region on an external surface of the electronic device. A localized haptic feedback response is provided responsive to detection of initial touch input within the defined region, and the control action is executed responsive to detection of a touch direction performed in association with the defined region following the detection of the touch input.

Haptics to identify button regions

A hinged multi-screen computing device is provided that includes a processor, at least one speaker, two display devices connected by a hinge containing a hinge sensor, and a housing with two parts, each including a display device. At least one of the displays is configured to display GUI controls, one which adjusts a volume balance between a first and second GUI element displayed on each of the first and second displays, and another which adjusts overall volume.

Growing community of inventors

Bothell, WA, United States of America

Adolfo Hernandez Santisteban