Twitch Interactive, Inc.

Amazon Technologies, Inc.

Ivan Marcin

Yueshi Shen

Abhinav Kapoor

Jorge Arturo Villatoro

Siddhartha Shankara Rao

John Joseph Dunne

Richard Newman

Tobias DiPasquale

Josh Tabak

Jeff Li

Eran Ambar

Matthew Louis Szatmary

Shawn Hsu

Tarek Amara

Martin Hess

Giridhar Kalpathy Narayanan

Alex Converse

Brad Schumitsch

Jennie Tietema

Eric D Cox

Jonas Bengtson

Implementations for combining at least two video streams received from devices of a plurality of participants of a video conference into a composite video stream are described. A video conference including the video streams received from the devices of the plurality of participants is established. A capability associated with consuming at least two of the video streams is received from at least one of the devices. The at least two video streams are then combined into a composite video stream based on the capability associated with consuming the at least two video streams. The composite video stream is transmitted to the at least one of the devices.

Dynamic cloud video composition

Implementations for combining a plurality of content based on instructions for a layout of a video conference are described. A video conference is established between a plurality of devices of participants of the video conference. First content is received from a device of the plurality of devices in the established video conference. Second content is also received. Instructions for a layout of the first content and the second content during the video conference is received. Based on the instructions for the layout, the first content and the second content are combined into a composite video stream. The composite video stream is saved or transmitted.

Programmable video composition layout

Various techniques for providing video feed redundancy are described herein. Instructions may be provided for switching input to an output video feed between two or more redundant input video feeds. In some examples, the redundant input video feeds may not be duplicates, may not be frame synchronized, may not be transmitted from the same location, may not be transmitted using the same network types or transmission protocols, and/or may not be initiated at the same time. In some examples, the instructions for video feed redundancy may be associated with respective authorization keys for the redundant input video feeds.

Video feed redundancy

A video packaging and origination service can include one or more encoder components that receive content for encoding and transmitting to requesting entities. Responsive to a request for content, an encoder can determine an initial set of parameters based on network measurements, including buffer size, bitrate and output resolution. Once the updated encoder component is instantiated and configured, the encoder can monitor performance and dynamically modify keyframe interval and framerate parameters to allow for streaming in lower bandwidth networks.

Managing encoding based on performance

Techniques for video encoding based on viewer feedback are described herein. Feedback data collected from viewers of video content may be used to determine a provider score value and a provide duration value. The provider score value may indicate a quantity of viewers for content from the provider. The provider duration value may indicate a transmission duration for content from the respective provider. An upgrade threshold may be determined, which is a value associated with assignment of additional channels for encoding of video content. When video content from the provider is available for transmission, the provider score for the provider may be compared to the upgrade threshold value to determine whether the additional channels will be assigned for encoding of the video content. In some examples, multiple upgrade thresholds may be employed, for example corresponding to multiple time ranges identified based on the provider duration value.

Video encoding based on viewer feedback

Techniques for output frame correction for unstable video streams are described herein. A video item may be transmitted via an input video stream from a first entity to a second entity over one or more electronic communications networks. The incoming frames from the input video stream may then be used, by the second entity, to generate an output video stream for presentation to one or more viewers. The transmission of the input video stream may temporarily become unstable and may be interrupted such that one or more frames of the input video stream are delayed and/or lost. When a transmission interruption is detected, the output video stream may be adjusted by inserting one or more correction frames into the output video stream. The inserted correction frames may include one or more repetitions of one or more prior frames in the output video stream and/or one or more interpolated frames.

Output frame correction for unstable video streams

The techniques described herein may, for example, allow a quantity of buffered video frames to be reduced, for example for use in adaptive bitrate (ABR) streaming and other streaming transmissions. The quantity of buffered video frames may be reduced by dropping certain selected buffered frames from a resulting video output that is displayed to the viewer. This may reduce end-to-end latency without requiring a change in frame rate or fast forwarding of the video output, which may sometimes not be available or permitted by a resulting video player. These buffer reduction techniques may sometimes be employed upon a determination that transmission conditions have stabilized and that holding large quantities of buffered video may be unnecessary. In some examples, the disclosed techniques may be particularly advantageous for live streaming scenarios, in which end-to-end latency may be particularly problematic for the viewer.

Buffer reduction using frame dropping

Growing community of inventors

Palo Alto, CA, United States of America

Ivan Marcin