Mux, Inc.

Twitch Interactive, Inc.

Amazon Technologies, Inc.

Matthew Louis Szatmary

Adam Brown

Matthew E Ward

Abhinav Kapoor

Jorge Arturo Villatoro

Jon Dahl

Nicholas Chadwick

Daniel Lin

Spencer Nelson

Cyrus Hall

Luke Curley

Scott Wang

Maciej Laszcz

Daniel Arthur McClain

Diana Lu

Phillip Conover

Scott Rabin

Yueshi Shen

Nick Chadwick

Eran Ambar

Ivan Marcin

Yuechuan Li

Martin Hess

Nikhil Purushe

Alex Converse

Graham Keefe Tremper

Justin Greer

A method includes: ingesting a video; initializing a timed command stream synchronized to the video; emulating transcoding of the video to derive a sequence of video characteristics of the video; populating the timed command stream with the sequence of video characteristics; segmenting the video into a series of mezzanine segments. The method further includes: for each mezzanine segment, in the series of mezzanine segments: retrieving instream video characteristics, in the sequence of video characteristics, contained within a first segment of the timed command stream corresponding to the mezzanine segment; retrieving upstream video characteristics, in the sequence of video characteristics, preceding the first segment of the timed command stream and informing transcoding of the mezzanine segment; transforming the instream video characteristics and the upstream video characteristics into a set of transcode commands; storing the set of transcode commands in command frames; and inserting the command frames into the mezzanine segment.

Method for audio and video just-in-time transcoding with command frames

A method includes: receiving a script configured to modify the audio-video file; calculating a performance metric based on execution of the script on a set of test files; classifying the script as performant based on the performance metric; defining a metadata store associated with the script and the audio-video file; receiving a playback request specifying a rendition of the audio-video file from a computational device; in response to receiving the playback request: accessing a set of data inputs from the metadata store; executing the script on a frame of the audio-video file based on the set of data inputs to generate a modified frame of the audio-video file; transcoding the modified frame of the audio-video file into the rendition to generate an output frame of the audio-video file; and transmitting the output frame of the audio-video file to the computational device for playback at the computational device.

Method for on-demand video editing at transcode-time in a video streaming system

A method including: ingesting a video segment and a set of video features of the video segment; estimating a part size distribution for the video segment based on the set of video features and a first rendition of the video segment; calculating a maximum expected part size based on a threshold percentile in the part size distribution; at a first time, transmitting, to an video player, a manifest file indicating a set of byterange-addressable parts of the video segment in the first rendition, each byterange addressed part characterized by the maximum expected part size; at a second time, receiving, a playback request for a first byterange-addressable part; transcoding the first byterange-addressable part; in response to the maximum expected part size exceeding a size of the first byterange-addressable part in the first rendition, appending padding data to the first byterange-addressable part; and transmitting the first byterange-addressable part to the AV player.

Method for just-in-time transcoding of byterange-addressable parts

Method for on-demand video editing at transcode- time in a video streaming system

A video packaging and origination service can include one or more encoder components that receive content for encoding and transmitting to requesting entities. Responsive to a request for content, an encoder can determine an initial set of parameters based on network measurements, including buffer size, bitrate and output resolution. Once the updated encoder component is instantiated and configured, the encoder can monitor performance and dynamically modify keyframe interval and framerate parameters to allow for streaming in lower bandwidth networks.

Managing encoding based on performance

Techniques for estimation of bandwidth for transfer of video content in chunked transfer mode are described herein. A number of chunk samples may be collected during video content transmission. For each chunk sample, its respective delivery speed may be compared to its respective encoding bitrate. If the delivery speed is greater than or equal to the encoding bitrate, then the chunk sample may be included in a primary set of chunk samples. The primary set of chunk samples may be clustered into a lower speed cluster and a higher speed cluster. A representative speed, such as an average or weighted average speed, of the delivery speeds of the chunk samples in the lower speed cluster may be determined, and the bandwidth may be estimated based on the representative speed.

Chunked transfer mode bandwidth estimation

First streaming video content may be received from a provider. The provider may issue a request to replace part of the first streaming video content with replacement content, such as advertisements. Second streaming video content may be selected as a replacement for a first video player, while third streaming video content may be selected as a replacement for a second video player. Instructions may be sent to the first and the second video player to play a first portion of the first streaming video content, followed by their respective selected replacement content, followed by a third portion of the first streaming video content, with the respective selected replacement content replacing a second portion of the first streaming video content. Replacement of the second portion of the first streaming video content may sometimes introduce latency, which may be reduced using various techniques.

Session-specific streaming content replacement

Provider-requested streaming content replacement

Latency reduction for streaming content replacement

Techniques for improved rendition switching in association with adaptive bitrate streaming are described herein. The disclosed techniques may allow switching between segments at P-frames in addition to IDR-frames. By allowing switching at P-frames, the disclosed techniques may improve efficiency by, for example, reducing end-to-end latency without causing an undesirable decrease in image quality and image fidelity. In some examples, switching to a lower image quality rendition (e.g., lower bitrate, lower resolution, etc.) may be accomplished using P-frame switching, IDR-frame switching or both. Also, in some examples, switching to a higher image quality rendition (e.g., higher bitrate, higher resolution, etc.) may be accomplished using only IDR-frame switching.

Rendition switching

Growing community of inventors

Walnut Creek, CA, United States of America

Matthew Louis Szatmary