Microsoft Technology Licensing, LLC

Other

Microsoft Corporation

Todd R Manion

Jeremy Lee Dewey

Sandeep Singhal

Ravi Rao

Robert D Donner

Ryan Yonghee Kim

Scott A Senkeresty

Rohit Gupta

Philip Andrew Edry

Robert Norman Heitkamp

Donald F Box

David G Thaler

Shiraz Jitendra Cupala

Zhangwei Xu

Curt Andrew Steeb

Min Liu

Noah Horton

Anthony Vincent Discolo

Martin James Gudgin

Edmund Samuel Victor Pinto

Upshur Parks

Kestutis Patiejunas

Aaron Wesley Cunningham

John E Brezak

Gursharan Singh Sidhu

Rob M Mensching

Wissam S Kazan

Tomer Weisberg

Noel Wayne Anderson

Christian F Huitema

Nir Nice

Dan Teodosiu

Sandeep Kishan Singhal

Andrew John Fuller

Boyd Cannon Multerer

Melissa Wood Dunn

David T Jones

Akash Jeevan Sagar

Aditya G Bhandarkar

Karthik Raman

Zsolt Mathe

Ravipal S Soin

Ashish Gupta

Noah Benjamin Edelstein

David Richard Reed

Ori Amiga

Guhan Suriyanarayanan

Alain Franck Gefflaut

Brian R Lieuallen

Kevin C Ransom

Grigori M Somin

Eliot John Flannery

Steven Marcel Elza Wilssens

Pritam De

Kean Ee Lim

Grant Gardner

Edmund Hon-Sum Lui

Ryan B Elgram

Steven P Trombetta

Upshur Warren Parks, Iii

Radu Simionescu

Steven Wilssens

James Andrew Goossen

Pallavi Choudhury

Michael Shappell

Matthew S Baker

Travis C Luke

Arsalan Ahmad

Carl M Carter-Schwendler

Farookh P Mohammed

Padmini Chandrasekhar Iyer

Alain Gefflaut

Anirudh Anirudh

Junfeng Zhang

Nishant Gupta

Tyler M Barton

Matthew Jason Pope

Joshua C Zana

Marcelo Lopez Ruiz

Nitin Sharma

Shyam Sujeewa Habarakada

Jeson Patel

Kevin R Tao

Andre R Classen

Geogy A Samuel

Chinweizu Uzodinma Owunwanne

Kanaka Komandur

Ronald O Zink

Noah Norton

Robert D Donnor

Eric Langlois

Ed Pinto

Ramakrishna P Pamulapati

Ravi T Rao

Aaron W Cunningham

Gursharan S Sidhu

Shyam S Habarakada

A system for enabling spatializing audio data is provided. The system analyzes audio data to identify when to generate spatialized audio data. The system can receive incoming audio data including a plurality of channel-based audio signals as well as object-based audio. The system performs an analysis of the audio data and/or metadata associated with the audio data to determine when to generate the spatialized audio data. The system can identify one or more categories associated with the audio data (e.g., stereo, mono, game effect, . . . ) and use the category to determine whether to spatialize the audio data or not spatialize the audio data.

Spatializing audio data based on analysis of incoming audio data

Device linking is described. In one or more implementations, data is maintained at a network service that describes characteristics of a plurality of devices that are associated with a user account of the network service. A communication is formed to be received by one of the plurality of devices that includes a portion of the data that pertains to another one of the plurality of devices and that is suitable by the receiving device to discover the other one of the plurality of devices to initiate a local network connection between the devices.

Device linking

A game engine may generate video and audio content on a per-frame basis. Audio data corresponding to a current frame may be generated to comprise sound-field information independent of a speaker configuration or spatialization technology that may be used to play the associated audio. The sound-field may be generated based on monaural audio data corresponding to a sound produced by an in-game object at the object's position as of the current frame. The sound-field information may be transmitted to a remote computing device for reproduction using a selected, available speaker configuration and spatialization technology.

Game streaming with spatial audio

The present disclosure provides a number of techniques for personalization of spatial audio across a plurality of systems. A participant media system participating in a session may generate two outputs: personalized audio data and depersonalized audio data. When a spectator attempts to spectate the session, a media sharing platform may distribute shared depersonalized audio data to the spectator system. Based on this shared depersonalized audio data, the spectator media system can personalized the audio data to cause an endpoint device to render spectator personalized audio based on HRTF data for the spectator. Accordingly, the spectator personalized audio is personalized and allows a rich, immersive spectating experience that overcome drawbacks associated with receiving personalized audio from participant systems.

Personalization of spatial audio for streaming platforms

A system for streaming spatial audio and video is provided. In response to a request to share a virtual reality session, a characteristic of a second audio output device and a characteristic of a second video output device can be determined. Further in response to the request, based on the determined characteristic of the second audio output device, spatial audio can be provided to the second audio output device and received virtual reality video can be transcoded based on the determined characteristic of the second video output device. The transcoded virtual reality video can be provided to the second video output device so that other(s) can experience the virtual reality session.

Streaming of augmented/virtual reality spatial audio/video

The techniques disclosed herein provide a high fidelity, rich, and engaging experience for spectators of streaming video services. The techniques disclosed herein enable a system to receive, process and, store session data defining activity of a virtual reality environment. The system can generate recorded video data of the session activity along with rendered spatial audio data, e.g., render the spatial audio in the cloud, for streaming of the video data and rendered spatial audio data to one or more computers. The video data and rendered spatial audio data can provide high fidelity video clips of salient activity of a virtual reality environment. In one illustrative example, the system can automatically create a video from one or more camera positions and audio data that corresponds to the camera positions.

Multiple listener cloud render with enhanced instant replay

Active gameplay of a video game on a computer gaming device is overseen by a platform-level in-game recording companion that executes separately from any of a plurality of different video games. During active gameplay of the video game, the active gameplay is continuously and automatically buffered to a temporary storage buffer. During active gameplay the computer gaming device receives a command to save a segment of the active gameplay for subsequent viewing. While displaying gameplay of the currently-executing video game, an interface for the platform-level in-game recording companion is displayed. The segment of the active gameplay is saved from the temporary storage buffer to a library of the platform-level in-game recording companion.

Recording companion

The present disclosure provides a number of techniques for personalization of audio for communication to an endpoint device. According to one technique, a cloud-based computing device may receive media data from a media platform, and generate depersonalized audio data based on the media data, the depersonalized audio data including at least one audio component associated with the media platform. The technique may further generate user personalized audio data based on the depersonalized audio data. The user personalized audio data may include at least one audio component personalized based on a unique head-related transfer function (HRTF) data associated with a user or default HRTF data. The user personalized audio may be communicated to the endpoint device for consumption by the user. Such techniques reduce the need for advanced audio processing technologies on client systems and makes personalized audio more available to users.

Remote personalization of audio

Active gameplay of a video game on a computer gaming device is overseen by a platform-level in-game recording companion that executes separately from any of a plurality of different video games. During active gameplay of the video game, the active gameplay is continuously and automatically buffered to a temporary storage buffer. During active gameplay the computer gaming device receives a command to save a segment of the active gameplay for subsequent viewing. Without interrupting the active gameplay, the segment of the active gameplay is saved from the temporary storage buffer to a library of the platform-level in-game recording companion.

Various embodiments relating to providing video game instant replays are disclosed. In one embodiment, a currently playing video game is overseen by a platform-level instant replay companion that executes separately from any of a plurality of different video games. A most recently played portion of rendered gameplay from the currently playing video game is automatically and continuously recorded with the platform-level instant replay companion. A recorded gameplay segment from the most recently played portion of rendered gameplay is displayed with the platform-level instant replay companion.

Computing application instant replay

A Distributed Routing Table (DRT) mesh can comprise two or more nodes, each of which maintains its own routing table that represents some or all of the overall routing knowledge of the DRT mesh. Each node can be comprised of modular components that can perform various defined functions such that the features and abilities of the node can be customized by an application based on which modular components are instantiated. A routing table management module can maintain individual routing tables at each node, and can ensure that only entries that are close to the node, in a network topology sense, are maintained in the routing table. In addition, a security module can verify received messages based on an agreed-upon root certificate.

Distributed routing table architecture and design

Example apparatus and methods concern an improved immersive experience for a video gamer that is provided by controlling a game based on the three dimensional location and orientation of a control and display device held by or otherwise associated with the gamer. The location is determined from data comprising a three dimensional position and an orientation of a portion of a player in a three dimensional space associated with a computerized game. The facing and rotation of the device is determined as a function of both the location of the device and the orientation of the device. The orientation may be determined by data from motion sensors in or on the device. Example apparatus and methods control the computerized game based, at least in part, on the position of the device, the facing of the device, and the rotation of the device.

Locating and orienting device in space

Growing community of inventors

Redmond, WA, United States of America

Todd R Manion