Qualcomm Incorporated

Snap Inc.

Chao Pang

Marta Karczewicz

Joel Sole Rojals

Krishnakanth Rapaka

Rajan Laxman Joshi

Vadim Seregin

Ye-Kui Wang

Xiang Yang Li

Michael David Marr

Liwei Guo

Cheng-Teh Hsieh

Jun Huang

Michael Ronald Cieslak

Jiayao Yu

Zahra Ferdowsi

Aleksandr Zhang

Finn Parnell

Jianle Chen

Ying Hai Chen

Rong Yan

Liu Liu

Li Feng Zhang

Wei Pu

Woo-Shik Kim

Wei-Jung Chien

Xiang Li

Feng Zou

Haoyun Wu

Xiangying Ma

Jianliang Hao

Ying Chen

A system is provided that detects a start of a camera session, captures initial raw data frames and stores them in memory. Upon determining that the camera session corresponds to a video recording session, the system activates a video recording pipeline and upon determining that the video recording pipeline is active, the system retrieves the initial raw data frames, encodes the initial raw data frames using the video recording pipeline, accesses additional captured raw data frames, and encodes the additional captured raw data frames using the video recording pipeline until detection of an end of the camera session. Upon detecting an end of the camera session, the system deactivates the video recording pipeline.

Buffered video recording

Among other things, embodiments of the present disclosure improve the functionality of electronic messaging and imaging software and systems by automating the client-side transcoding of video data based on content. For example, an appropriate transcoding configuration can be selected for video data having complex motion or textures. Accordingly, video quality can be improve when complex motions or textures are present.

Content-based client side video transcoding

The subject technology determines, by at least one processor, that a value of a capability parameter is not available for a first recipient device, the first recipient device being one of a plurality of recipient devices. The subject technology receives, from the first recipient device, a value of the capability parameter. The subject technology clusters, by at least one processor, the plurality of recipient devices into a plurality of groups of recipient devices based on device capabilities including an available storage space. The subject technology determines, for each group of recipient devices, a set of content parameters compatible with device capabilities of the plurality of recipient devices of a group of client devices. The subject technology generates, for each group of recipient devices, a version of content according to an associated set of content parameters.

Recipient-based content optimization in a messaging system

In an example, a method of decoding video data includes generating a residual block of a picture based on a predicted residual block including reconstructing one or more residual values of the residual block based on one or more predicted residual values of the residual block. The method also includes generating a current block of the picture based on a combination of the residual block and a prediction block of the picture.

Residual prediction for intra block copying

Aspects of the present disclosure involve a system and method for optimizing a content shared via a messaging system based on an expected audience for the content. A content is received from a publisher client device associated with a publisher. A list of content versions associated with the publisher is accessed form a database, each content version being associated with an associated set of content parameters. The one or more content versions of the content are generated. When an access request is received from a viewer client device, an optimal content version is identified for the viewer client device based on the device capabilities of the viewer client device. An updated list of content versions is associated with the publisher by aggregating the optimal content versions identified for a plurality of viewer client devices, and the database is updated with the updated list of content versions associated with the publisher.

Audience-based content optimization in a messaging system

Aspects of the present disclosure involve a system and method for providing the best available version of a content to a viewer client device considering the device capabilities of the viewer client device. To access the content, a viewer client device sends an access request comprising its device capabilities. Upon receiving the access request, the server computer generates a ranked list of all possible content versions for the viewer client device, the content versions being ranked based on their compatibility with the device capabilities of the viewer client device. The server computer selects, among the one or more available versions of the content, the content version ranked first in the ranked list and provides the selected content version to the viewer client device.

Targeted content distribution in a messaging system

The subject technology accesses, by at least one processor, device capabilities for each of a plurality of recipient devices. The subject technology clusters, by the at least one processor, the plurality of recipient devices into a plurality of groups of recipient devices based on device capabilities. The subject technology determines, for each group of recipient devices, a set of content parameters compatible with the device capabilities of the plurality of recipient devices of a group of client devices. Further, the subject technology generates, for each group of recipient devices, a version of the content according to an associated set of content parameters.

An example method for encoding or decoding video data includes storing, by a video coder and in a reference picture buffer, a version of a current picture of the video data, including the current picture in a reference picture list (RPL) used to predict the current picture, and coding, by the video coder and based on the RPL, a block of video data in the current picture based on a predictor block of video data included in the version of the current picture stored in the reference picture buffer.

Using a current picture as a reference for video coding

Aspects of the present disclosure involve a system and method for performing operations comprising receiving, by one or more processors, from a sender device, a content to be shared with one or more recipients via a messaging application; identifying, by the one or more processors, at least one recipient device for each recipient; accessing, by the one or more processors, device capabilities for each of the one or more recipient devices; determining, by the one or more processors, a set of content parameters compatible with the device capabilities of the recipient devices; and generating, by the one or more processors, a version of the content according to the set of content parameters.

A device for decoding video data includes a memory configured to store the video data and one or more processors configured to receive a slice of the video data, parse an intra block copy (IBC) syntax element to determine that an IBC mode is enabled for the slice, parse a slice type syntax element associated with the slice to determine the slice is an I slice, and decode the slice as an I slice by decoding all blocks of the slice using intra prediction coding modes.

Slice level intra block copy and other video coding improvements

A video coder may determine a search region for coding a current block of video data using Intra Block Copy (Intra BC). In some examples, the video coder determines a central point for the search region, and determines the search region for the current block based on the central point and a defined size for the search region. The video coder stores reconstructed blocks of the video data from a current picture that includes the current block in a memory based on the determined search region. The video coder codes information from which to identify one of the reconstructed blocks within the search region, and codes the current block based on the identified one of the reconstructed blocks according to Intra BC.

Growing community of inventors

San Diego, CA, United States of America

Chao Pang