Facebook, Inc.

Twitch Interactive, Inc.

Eran Ambar

Abhinav Kapoor

Yueshi Shen

Jorge Arturo Villatoro

Yuechuan Li

Shawn Hsu

Spencer Nelson

Andrew Francis

Cyrus Hall

Martin Hess

Jeffrey Garneau

Jyotindra Vasudeo

Chih-Chiang Lu

Sergiy Bilobrov

Matthew Louis Szatmary

Ivan Marcin

Tarek Amara

Trevor Charles Armstrong

Nikhil Purushe

Maksim Khadkevich

David Yu Zhang

Graham Keefe Tremper

Jonas Bengtson

Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, a playlist may include both currently encoded segments, which are segments that are fully encoded at or before playlist generation, and also future encoded segments, which are segments that have not yet been fully encoded at playlist generation. In some cases, the inclusion of future encoded segments in a playlist may result in a player requesting a segment that has not yet been fully encoded at the time that the request is received by the server. In some examples, even though the segment is not yet fully encoded, the server may nevertheless save and process the request, for example by transmitting encoded portions of the requested segment as those portions are made available by the encoder.

Streaming playlist including future encoded segments

Techniques for low latency streaming, for example in a broadcasting environment, are described herein. In some examples, one or more individual renditions may be encoded into multiple rendition versions associated with different respective latencies. Also, in some examples, one or more individual renditions may be encoded into multiple rendition versions having different respective amounts of forward error correction (FEC), for example by an edge node of a video streaming service. Also, in some examples, video may be broadcast using a protocol that does not require retransmission of lost packets, such as Web Real-Time Communication (WebRTC), which is commonly used for point-to-point transmissions. Also, in some examples, one or more servers may receive quality of service feedback information from each player to which video content is transmitted. The one or more servers may use this feedback information to select and switch between appropriate renditions and rendition versions for each player.

Server-based encoded version selection

Various techniques for providing video feed redundancy are described herein. Instructions may be provided for switching input to an output video feed between two or more redundant input video feeds. In some examples, the redundant input video feeds may not be duplicates, may not be frame synchronized, may not be transmitted from the same location, may not be transmitted using the same network types or transmission protocols, and/or may not be initiated at the same time. In some examples, the instructions for video feed redundancy may be associated with respective authorization keys for the redundant input video feeds.

Video feed redundancy

Systems, methods, and non-transitory computer-readable media can store fingerprint data corresponding to one or more content items in an index data structure, the index data structure comprising a set of bins, wherein at least one first bin references a list of fingerprinted frames, and wherein at least one fingerprinted frame in the list corresponds to a first content item. A determination is made that one or more fingerprinted frames corresponding to a second content item are to be added to the index data structure. At least one of the fingerprinted frames corresponding to the second content item are added to the list of fingerprinted frames that is referenced by the first bin.

Systems and methods for storing content

Requesting transmission of future encoded segments

Intra-rendition latency variation

Systems, methods, and non-transitory computer-readable media can generate at least one fingerprint based on a set of frames corresponding to a test content item, generate a set of distorted fingerprints using at least a portion of the fingerprint, and determine one or more reference content items using the set of distorted fingerprints, wherein the test content item is evaluated against at least one reference content item to identify matching content.

Systems and methods for identifying matching content

Systems, methods, and non-transitory computer readable media can receive a request to upload a file from a user. A server of a plurality of servers can be determined to process the request to upload the file. An indication of an amount of the file that has been received by the server prior to the request to upload the file can be provided. At least a portion of the file that has not been received by the server prior to the request to upload the file can be received.

Systems and methods for resumable uploading of data in a social networking system

An online system stores media files (i.e., stored media files) and receives a user request to upload a video file (i.e., a requested media file). The online system determines whether the requested media file matches one of the stored media files based on hash values. If there is a mismatch in hash value, the online system may determine the match based on fingerprints. If it is determined that the requested media file does not match any stored media file, the online system stores the requested media file. Even if there is a match, the online system compares a quality of the requested media file with the matched media file and replaces the matched media file with the requested media file having a higher quality metric.

Media file upload awareness for online systems

Systems, methods, and non-transitory computer-readable media can define a set of video quality levels. One or more social engagement signals associated with videos uploaded at each video quality level out of the set of video quality levels can be acquired. Information associated with each user out of a set of users can be acquired. A respective video quality level for each user can be determined based on at least one of the information associated with each user or the one or more social engagement signals.

Systems and methods for determining quality levels for videos to be uploaded

Techniques for estimation of bandwidth for transfer of video content in chunked transfer mode are described herein. A number of chunk samples may be collected during video content transmission. For each chunk sample, its respective delivery speed may be compared to its respective encoding bitrate. If the delivery speed is greater than or equal to the encoding bitrate, then the chunk sample may be included in a primary set of chunk samples. The primary set of chunk samples may be clustered into a lower speed cluster and a higher speed cluster. A representative speed, such as an average or weighted average speed, of the delivery speeds of the chunk samples in the lower speed cluster may be determined, and the bandwidth may be estimated based on the representative speed.

Chunked transfer mode bandwidth estimation

Forward error correction for low latency streaming

Growing community of inventors

Sunnyvale, CA, United States of America

Eran Ambar