Google Inc.

Francis William Galligan

Paul Gordon Wilkins

Adrian Grange

Aaron James Colwell

Duncan MacLean

Yaowu Xu

David Kimbal Dorwin

Andrew Scherkus

Jim Bankoski

John Koleszar

Encoding and decoding using advance coded reference prediction may include identifying a sequence of temporally adjacent frames from the plurality of frames, wherein each frame in the sequence of temporally adjacent frames is associated with a respective frame position indicating a temporal location the sequence, encoding a first frame from the sequence as an intra-coded frame, generating an alternate reference frame by reconstructing the first encoded frame, encoding a second frame from the sequence with reference to a reference frame, the second frame associated with a second frame position, including the first encoded frame in a compressed bitstream at a first bitstream position, and including the second encoded frame in the compressed bitstream at a second bitstream position, wherein the second bitstream position is later than the first bitstream position and wherein the first frame position is later than the second frame position.

Advance coded reference prediction

A system and method for decrypting encrypted media that have changing initialization vectors and keys is disclosed. As encrypted media is received and played back, the encrypted frames can be monitored (e.g., checked) to detect whether or not initialization vectors are prepended to them. If a prepended initialization vector is detected, the prepended initialization vector is used to facilitate the decryption of the encrypted frame. If no prepended initialization vector is detected, a new initialization vector is generated by using a last portion of bytes of the preceding encrypted frame and the new initialization vector is used to facilitate the decryption of the encrypted frame. A signal byte can be included to signal whether the frame is encrypted or not, whether an initialization vector is included, and other information about the encrypted frame.

System and methodology for decrypting encrypted media

Systems and methods are provided herein relating to adaptive video streaming. Time-to-offset mapping associated with a set of video blocks can be broken up into chunks. A client can download a first set of seek index chunks and use the first set of seek index chunks to select a stream. Seek index chunks within remaining sets of seek index chunks can be ranked for relevance based on client capabilities. A subset of remaining sets of seeks index chunks can be downloaded based on the rankings and client capabilities during streaming. Chunked time-to-offset mapping can facilitate faster startup when playing streamed video.

Adaptive streaming using chunked time-to-offset mapping

Implementations of the teachings herein include coding video data with an alternate reference frame generated using a temporal filter. The alternate reference frame is generated by determining a first weighting factor, for each corresponding block of a respective frame of a filter set, that represents a temporal correlation of the block with the corresponding block, determining a second weighting factor, for each pixel for each corresponding block of the respective frame of the filter set, that represents a temporal correlation of the pixel to a spatially-correspondent pixel in the block, determining a filter weight for each pixel in the block and for each spatially-correspondent pixel is each corresponding block based on the first weighting factor and the second weighting factor, and generating a weighted average pixel value for each pixel position in the block to form a block of the alternate reference frame based on the filter weights.

Coding video data with an alternate reference frame generated using a temporal filter

This disclosure relates to adaptive streaming for legacy media frameworks. A streaming component includes a reception component that receives a first set of header data associated with an audio stream, and a second set of header data associated with a video stream. A parsing component synthesizes a third set of header data using the first set of header data and the second set of header data based on a set of header criteria for a legacy media framework, and provides the third set of header data to the legacy media framework. A download component acquires respective sets of data from the audio stream and the video stream, and an adaption component provides sets of data to the legacy media framework based on a set of streaming criteria for the legacy media framework.

Adaptive streaming for legacy media frameworks

Embodiments are directed towards enabling a portion of a protected content stream to be played in a degraded quality or experience at a client device when a key and/or license for some other portion of the content stream is unobtainable, or is not obtained by the client device. A content stream has a plurality of layers, with a baseline layer having a lowest quality level of the plurality of layers that is unencrypted, while at least one other layer is encrypted. When the key to decrypt the encrypted layer(s) is unobtained, at least the baseline unencrypted layer is allowed to still play at the client device.

Allowing degraded play of protected content using scalable codecs when key/license is not obtained

A method and apparatus for performing implicit video location augmentation are provided. Implicit video location augmentation may include identifying a first geolocation for a first frame from a plurality of video frames based on a first image captured by the first frame, identifying a second geolocation for a second frame from the plurality of video frames based on a second image captured by the second frame, determining, by a processor, a third geolocation for a third frame from the plurality of video frames based on the first geolocation and the second geolocation, and storing an updated plurality of video frames such that the first frame is associated with the first geolocation, the second frame is associated with the second geolocation, and the third frame is associated with the third geolocation.

Implicit video location augmentation

Embodiments of an apparatus and method for decoding an encoded bitstream to generate a video signal are taught. A decoder receives the bitstream and decodes a portion thereof to obtain at least a portion of a predictive reference frame. The reference frame is generated by, for example, selecting a filter set including a target frame with a block having a plurality of pixels and at least one adjacent frame, determining a coding mode associated with the block, determining a block-specific factor derived from the coding mode, determining weighted averages of pixels in the filter set and using the weighted averages to generate the predictive reference frame. The decoder also generates a residual from another portion of the encoded bitstream that represents a portion of a frame of the plurality of frames and reconstructs the portion of the frame by adding the residual to the predictive reference frame.

Apparatus and method for decoding video encoded using a temporal filter

A system and method for encoding a video is disclosed having a plurality of frames with spatially correspondent macroblocks. The method includes selecting a coding mode for each spatially correspondent macroblock, such as intra-frame coding or inter-frame coding. A weighting value is determined for each pixel in the macroblock based on the coding mode of the macroblock or other indication of the correlation of the pixel to spatially corresponding pixels in one or more other frames. A temporal filter uses the weighting values to filter noise from the plurality of frames and the resulting noise-reduced output is used in a predictive reference frame.

System and method for encoding video using temporal filter

Systems and methods are provided herein relating to adaptive video streaming. A time-to-offset mapping, also known as a seek index, associated with a set of video blocks can be used to more accurately estimate bandwidth for sections of a video. A video block among the set of video blocks can be dynamically selected as a function of client capabilities. Client capabilities can be dynamically monitored and a stream can be dynamically selected based on the dynamic monitoring. The benefits in using time-to-offset mapping to better estimate bandwidth can better maximize client performance and reliability when playing a video stream.

Growing community of inventors

Mountain View, CA, United States of America

Francis William Galligan