Microsoft Technology Licensing, LLC

Steven Wilssens

Robert Norman Heitkamp

Philip Andrew Edry

Ziyad Ibrahim

Paul J Radek

Brian C McDowell

Todd R Manion

Ryan Yonghee Kim

Ibrahim Ziyad

Anders Edgar Klemets

Shafiq Rahman

Matthew Bruce Andrews

Gabriel Frost

A content server system is provided that includes at least one processor configured to store a user account for a user at a content server of the content server system that is configured to serve server-side rendered content to a client computing device of the user. Audio is played out via a sound output device associated with the client computing device. The at least one processor is further configured to determine a licensing identifier associated with a device of the user or the user account of the user, send the licensing identifier to a third-party licensing server device, receive an indication that an active license is associated with the licensing identifier, determine that the user is authorized to access a digital rights managed audio rendering software, and cause audio of the server-side rendered content to be rendered using audio rendering algorithms of the digital rights managed audio rendering software.

Server-side audio rendering licensing

The techniques disclosed herein provide apparatuses and related methods for the communication of spatial audio and related metadata. In some implementations, a source provides prerecorded spatial audio that has embedded metadata. A computing device processes the prerecorded spatial audio to generate an audio codec that is segmented to include a first section of audio data and a second section that includes metadata extracted from the prerecorded spatial audio. The generated audio codec may be received by a device that includes an encoder. The encoder may process the generated audio codec to generate audio data that includes the metadata.

Frame coding for spatial audio data

A server system is provided that includes at least one processor configured to receive a set of client audio parameters from a client computing device, determine a set of audio tuning parameters based on the set of client audio parameters, execute a server-side rendered application program for the client computing device, render a stream of visual data for the server-side rendered application program based on a stream of user input received from the client computing device, render a stream of audio for the server-side rendered application program based on the set of audio tuning parameters, and send the stream of visual data and the stream of audio to the client computing device.

Server-side rendered audio using client audio parameters

The techniques disclosed herein provide application programming interfaces (APIs) for enabling a system to select a spatialization technology. The APIs also enable a system to balance resources by allocating audio objects to a number of applications executing on a computer system. The system coordinates the audio objects between applications and each application can control the number of objects they individually generate. In some configurations, the system can also fold audio objects across different applications. Different spatialization technologies can be selected based on an analysis of contextual data and policy data. For instance, when a new headphone system is plugged in, the system may switch from Dolby Atmos to the Microsoft HoloLens HRTF spatialization technology. The system can dynamically control a number of generated audio objects and dynamically change a utilized spatialization technology based on changes to a computing environment.

Enhanced adaptive audio rendering techniques

A game engine may generate video and audio content on a per-frame basis. Audio data corresponding to a current frame may be generated to comprise sound-field information independent of a speaker configuration or spatialization technology that may be used to play the associated audio. The sound-field may be generated based on monaural audio data corresponding to a sound produced by an in-game object at the object's position as of the current frame. The sound-field information may be transmitted to a remote computing device for reproduction using a selected, available speaker configuration and spatialization technology.

Game streaming with spatial audio

A system for enabling a shared three-dimensional ('3D') audio bed available to multiple software applications is provided. The system manages bed metadata defining a number of speaker objects of a 3D audio bed. The bed metadata also associates each speaker object with a location, which in some configurations, is defined by a three-dimensional coordinate system. The bed metadata is communicated to a plurality of applications. The applications can then generate custom 3D audio data that associates individual audio streams with individual speaker objects of the 3D audio bed. The applications can then communicate the custom 3D audio data to a 3D audio bed engine, which causes the processing and rendering of the custom 3D audio data to an output device utilizing a selected spatialization technology. Aspects of the 3D bed can be altered when the spatialization technology or the output device changes.

Shared three-dimensional audio bed

The techniques disclosed herein can enable a system to coordinate the processing of object-based audio and channel-based audio generated by multiple applications. The system determines a spatialization technology to utilize based on contextual data. In some configurations, the contextual data can indicate the capabilities of one or more computing resources. In some configurations, the contextual data can also indicate preferences. The preferences, for example, can indicate user preferences for a type of spatialization technology, e.g., Dolby Atmos, over another type of spatialization technology, e.g., DTSX. Based on the contextual data, the system can select a spatialization technology and a corresponding encoder to process the input signals to generate a spatially encoded stream that appropriately renders the audio of multiple applications to an available output device. The techniques disclosed herein also allow a system to dynamically change the spatialization technologies during use.

Adaptive audio rendering

Application programing interface for adaptive audio rendering

A remote media server provides a resource identifier to a digital media controller. A digital media controller passes this resource identifier to a digital media renderer. The digital media renderer launches an application that processes the resource identifier to access the remote media server and play back the media. Playback is responsive to controls from the digital media controller. The digital media renderer can play back media identified by the digital media controller, but that is encoded and protected in a manner specific to the digital media renderer. The digital media controller can shut down or become dormant to save battery power without affecting playback by the digital media renderer. By providing the information about available applications from the digital media renderer to the digital media controller, the digital media controller can reliably send resource identifiers for which applications are available the digital media renderer.

Growing community of inventors

Kenmore, WA, United States of America

Steven Wilssens