Google Inc.

Microsoft Technology Licensing, LLC

Microsoft Corporation

Michael D Dodd

Geoffrey R Smith

Peter T Barrett

Dustin Lyle Green

Grant Mohr

David C Clifford

Richard Eugene Fulcher

James Armand Baldwin

Benjamin David Eidelson

Randall Sarafa

Rodrigo Lima Carceroni

Kathryn Chapman Cushing

Mayur Kamat

Param Reddappagari

Shrikrishna Vijaykumar Borde

Gülay Birand

Ivan Bertona

Grant D Mohr

Wei Huang

Hans-Martin Krober

Evan Miller

Systems, methods and computer readable media for live interactions in persistent conversations are described. In some implementations, a method can include receiving a communication message sent from a first user to a second user, wherein the communication message includes initiation of a live interaction. The method can also include generating a live interaction user interface element for display as part of a persistent conversation interface. The method can further include storing a representation of the live interaction in a conversation content section of a persistent conversation object when the live interaction ends. The method can include updating conversation state information of the persistent conversation object to reflect the receiving of the communication message and the storing of the representation.

Live interaction in persistent conversations

Implementations relate to a system for video encoding and conversion including an image resolution conversion component operable to convert a resolution of a source image frame from a first resolution to a second resolution to produce a first intermediate image frame at the second resolution; an image conversion component operable to receive the first intermediate image frame and convert an image size of the first intermediate image frame to another image frame size to produce a first viewable image frame; an image viewer component operable to display the first viewable image on a first display; a color space conversion component comprising a luminance conversion component and a chrominance operable to receive the first viewable image frame and convent a first luminance value and a first chrominance value of the first viewable image frame to a second intermediate image frame having a second luminance value and a second chrominance value.

Video chat encoding pipeline

A system and techniques for converting a source image frame in a particular YUV format to another YUV format is presented. The system can include a texture component, a luminance component, and a chrominance component. The texture component can be configured to generate luminance input pixels and chrominance input pixels from the source image. The luminance input pixels can each include a luma component and the chrominance input pixels can each include a first chroma component and a second chroma component. The luminance component can be configured to generate luminance output pixels, where the luminance output pixels can each include a group of luminance input pixels. The chrominance component can be configured to generate chrominance output pixels, where the chrominance output pixels can each include a group of first chroma components or a group of second chroma components.

Color space conversion between semi-planar YUV and planar YUV formats

In general, this disclosure describes techniques for overlaying information related to a text message onto a video. In one example, a method includes receiving communication data at a first computing device that is sent from a second computing device while the first and second computing devices are engaged in a real-time video communication, wherein the communication data comprises video data. The method also includes displaying the video data on a display of the first computing device and receiving a text-based message at the first computing device that is sent from the second computing device during the real-time video communication. The method further includes overlaying information related to the text-based message onto the video data displayed on the display of the first computing device.

Text chat overlay for video chat

Accelerated channel change (ACC) strategies are described for supplying a client module with media information by transitioning between a first delivery of media information provided by first delivery functionality and a second delivery of media information provided by second delivery functionality without exceeding prescribed data rate limitations. The first delivery functionality can represent server-based functionality for delivering a unicast stream of media information at a data rate (or maximum data rate) of some excess amount over the nominal rate of delivery, starting at a selected location within the media information. The second delivery functionality can represent any functionality for delivering the media information at the data rate (or maximum data rate) of the nominal rate of delivery. A join interval separates the first delivery at the excess rate and the second delivery at the nominal rate. In that period, the first delivery functionality can provide media information at a join interval data rate. The join interval data rate, if it is below the nominal data rate, will cause the client module to miss packets of media information. The client module can receive these missing packets by issuing retry requests to the first delivery functionality or to some other entity. The client module can determine the excess amount available by investigating the amount of missing information that occurs at different data rates; or the excess amount can be defined in advance.

Accelerated channel change in rate-limited environments

Strategies are described for performing retry analysis in an environment which involves the transmission of media information from a source module to a target module. In the context of the source module, the retry analysis determines whether the source module should satisfy the retry requests issued by the target module. In the context of the target module, the retry analysis determines whether the target module should generate the retry requests in the first place. Novel request reporting formats are also described. The target module performs analysis to determine what reporting format it should use to convey the retry requests to the source module.

Retry strategies for use in a streaming environment

Tiered command distribution is described. In an embodiment, a pipeline architecture includes processor chains of data processors that process control events received from an application interface control. A tier assignment algorithm determines the longest path of data processors through the processor chains to determine a tier allocation for each data processor in the set of processor chains. Each tier includes a data processor from one or more of the processor chains where a first set of data processors in a first tier each receive a control event and process the control event and/or process the data according to the control event before a second set of data processors in a second tier each receive the control event.

Tiered sequential processing media data through multiple processor chains with longest path tier assignment of processors

Growing community of inventors

Mountain View, CA, United States of America

Michael D Dodd