Microsoft Technology Licensing, LLC

Daniel Diniz Niemeyer

Nicholas Jie Fang

Stefan Francis Slivinski

Gerald Albert Pogue, Jr

Quinn Damerell

Dylan Keith Garrett

Dharmanshu Kamra

A mobile computing device provides real-time streaming of multiple sources of audio and video. The mobile computing device receives audio and video streams from multiple sources, including a camera video stream, a microphone audio stream, a game audio stream, and a game video stream. The device adjusts microphone and/or the game input levels based on a user-selected audio mix setting to produce rebalanced microphone and game audio streams, multiplexes the rebalanced microphone and game audio streams to produce a multiplexed audio stream, and encodes the multiplexed audio stream to produce an encoded audio stream. The user-selected audio mix setting may be adjusted by a user of the mobile computing device. The mobile computing device packages the encoded audio stream with an encoded video stream of composited camera and game video streams into one or more streaming packets, and outputs the one or more streaming packets.

Audio balancing for multi-source audiovisual streaming

A method for low-latency streaming of audio and video via a mobile computing device to facilitate a high-quality, real-time interactive streaming experience. The method includes receiving an application audio stream generated by execution of an application program, an application video stream generated by execution of the application program, a microphone audio stream, and a camera video stream. The application audio stream and the microphone audio stream are mixed to produce a mixed audio stream. The application video stream and the camera video stream are composited to produce a composited video stream. The mixed audio stream is encoded to produce an encoded audio stream, and the composited video stream is encoded to produce an encoded video stream. The encoded audio and video streams are packaged into one or more streaming packets, and output, to a remote computing device.

Low-latency mobile device audiovisual streaming

Growing community of inventors

Seattle, WA, United States of America

Daniel Diniz Niemeyer