Google Inc.

Sam John

Thierry Foucu

Steve Benting

Lei Yang

Sang-Uok Kum

Alexander Jay Converse

Balineedu Adsumilli

Yao-Chung Lin

Akshay Gadde

Sasi Inguva

Di Chen

A learning model is trained for rate-distortion behavior prediction against a corpus of a video hosting platform and used to determine optimal bitrate allocations for video data given video content complexity across the corpus of the video hosting platform. Complexity features of the video data are processed using the learning model to determine a rate-distortion cluster prediction for the video data, and transcoding parameters for transcoding the video data are selected based on that prediction. The rate-distortion clusters are modeled during the training of the learning model, such as based on rate-distortion curves of video data of the corpus of the video hosting platform and based on classifications of such video data. This approach minimizes total corpus egress and/or storage while further maintaining uniformity in the delivered quality of videos by the video hosting platform.

Multivariate rate control for transcoding video content

Bitrate-adaptive segmentation is performed for transcoding a video stream uploaded to an online video platform for hosting and later playback to platform users. The video stream is segmented into chunks based on prediction-based bit costs determined for frames of the video stream rather than based on scene changes detected within the video stream. The bitrate-adaptive segmentation includes determining inter-prediction bit costs and intra-prediction bit costs for frames of the video stream based on information indicated within a pass log based on a first pass encoding of the video stream, determining chunk boundaries for segmenting the video stream into a chunk based on the inter-prediction bit costs and the intra-prediction bit costs for the frames, and transcoding the chunk to produce a transcoded video stream.

Bitrate-adaptive segmentation for video transcoding

A request for a video may be received from a client device. A determination whether to transmit the video at a first video resolution or a second video resolution based on a quality of the video at the first video resolution when converted to the second video resolution at the client device may be made. The video may be transmitted to the client device at the determined first video resolution or the second video resolution.

Bitrate selection for video streaming

Implementations disclose adaptive rate control technology that selects different encoders for different chunks of a media item based on the complexity of the individual chunks. A method includes accessing a media item comprising a first chunk and a second chunk; determining, by a processing device, a first media complexity measure for the first chunk and a second media complexity measure for the second chunk; selecting, by the processing device, a first encoder and a second encoder from a plurality of encoders, wherein the first encoder is selected based on the first media complexity measure of the first chunk and the second encoder is selected based on the second media complexity measure of the second chunk; and encoding the first chunk using the first encoder and encoding the second chunk using the second encoder.

Complexity adaptive rate control

Systems and methods for processing a video sequence are disclosed. In accordance with some implementations, The method includes determining a first set of shot-change locations associated with a cut transition in a video sequence based on variance data defined in an encoding log associated with at least one previously encoded video frame. The method further includes determining a second set of shot-change locations associated with a fading transition in the video sequence based on the variance data defined in the encoding log associated with the at least one previously encoded video frame. The method also includes processing the video sequence based on at least a portion of the first set of shot-change locations and the second set of shot-change locations.

Video content analysis and/or processing using encoding logs

Videos associated with video resolutions may be received. A first bitrate for each of the video resolutions may be identified based on a first bitrate point associated with the videos where a quality of the videos at a first video resolution that is upscaled to a second video resolution is better than a quality of the videos at the second video resolution at bitrates below the first bitrate point. The upscaling of the first video resolution may correspond to converting the videos from the first video resolution to the second video resolution at a client device. The identified corresponding first bitrate may be assigned to each of the video resolutions.

A plurality of videos associated with a plurality of video resolutions may be received. A minimum bitrate may be identified for each of the video resolutions based on a first bitrate point associated with the videos where a quality of the videos at a first video resolution that is upscaled to a second video resolution is better than a quality of the videos at the second video resolution at bitrates below the first bitrate point. Furthermore, a maximum bitrate may be identified for each of the video resolutions based on a second bitrate point where the rate of change of the quality of the videos is below a threshold value. The identified minimum bitrates and the maximum bitrates may be assigned to the video resolutions.

A system to facilitate analyzing and/or processing video content using encoding logs is provided. The system includes a first analysis component, a second analysis component and a transcoding component. The first analysis component determines a first set of shot-change locations associated with a cut transition in a video sequence based on an encoding log associated with at least one previously encoded video frame. The second analysis component determines a second set of shot-change locations associated with a fading transition in the video sequence based on the encoding log associated with the at least one previously encoded video frame. The transcoding component processes the video sequence based on at least a portion of the first set of shot-change locations and the second set of shot-change locations.

Growing community of inventors

Fremont, CA, United States of America

Sam John