Interdigital Vc Holdings, Inc.

Thomson Licensing

Qualcomm Incorporated

Apple Inc.

Thomson Licensing Dtv

Interdigital Madison Patent Holdings

Interdigital Madison Patent Holdings, Sas

Beijing Dajia Internet Information Technology Co., Ltd.

Thomas Licensing

Yunfei Zheng

Peng Yin

Joel Sole

Xiaoan Lu

Qian Xu

Marta Karczewicz

Hsi-Jung Wu

Xianglin Wang

Muhammed Zeyd Coban

Xiaosong Zhou

Chris Yoochang Chung

Liwei Guo

Joel Sole Rojals

Rajan Laxman Joshi

Alexandros Michael Tourapis

Jiefu Zhai

Jun Xin

Albert E Keinath

Alican Nalci

Yeqing Wu

Yang Hu

Wei-Jung Chien

Dazhong Zhang

Yixin Du

Jae Hoon Kim

Ke Zhang

Hilmi Enes Egilmez

Shujie Liu

Peisong Chen

Cristina Gomila

Peikang Song

David R Conrad

Adeel Abbas

Yi-Wen Chen

Mei Guo

Oscar Divorra Escoda

Guoxin Jin

Yucong Chen

Yue Huang

Xing Wen

QiAn Xu

Li Feng Zhang

Vadim Seregin

Ying Hai Chen

Geert Van Der Auwera

Kiran Mukesh Misra

Jun Xu

Qian Chen

Xingyu Zhang

Rong Zhang

Weiyao Lin

Dung Trung Vo

Jingteng Xue

Jole Sole

Jean Begaint

Methods and apparatus are provided for intra coding a block having pixels assigned to groups. An apparatus includes a video encoder for encoding a block in a picture using intra prediction by dividing pixels within the block into at least a first group and a second group and encoding the pixels in the first group prior to encoding the pixels in the second group. A prediction for at least one of the pixels within the second group is obtained by evaluating the pixels within the first group and the second group.

Methods and apparatus for intra coding a block having pixels assigned to groups

Techniques are proposed to improve temporal motion projection in video coding. Candidate reference frames available for use in temporal motion projection are sorted in processing order according to scores assigned based on estimates of the reference frames' suitability for prediction. Such estimates may be based on temporal distance between each candidate reference frame and that reference frame's prediction references. Estimates may be based, for each reference frame, based on an estimate of coding quality of a reference frame from which the respective candidate reference frame makes a prediction reference. Once sorted, the candidate reference frames may be processing in the sorting order to supply prediction data to a current frame that is to be coded from the candidate reference frames. Additionally, hardware friendly designs of motion field hole filling and motion vector smoothing operations are proposed. Such designs can reduce hardware implementation complexity and benefit hardware parallel processing in several aspects: by removing the dependency among different processing block rows for hole filling and motion vector smoothing so that it is becomes easier and friendlier to achieve hardware parallel processing; by reducing the hardware bandwidth loading overhead; by improving hardware pipeline throughput; and/or by avoiding adding a line buffer to store the data from the above row since a line buffer will increase hardware cost.

Hardware friendly design for motion field processing and quality improvement of motion field

Improved neural-network-based image and video coding techniques are presented, including hybrid techniques that include both tools of a host codec and neural-network-based tools. In these improved techniques, the host coding tools may include conventional video coding standards such H.266 (VVC). In an aspects, source frames may be partitioned and either host or neural-network-based tools may be selected per partition. Coding parameter decisions for a partition may be constrained based on the partitioning and coding tool selection. Rate control for host and neural network tools may be combined. Multi-stage processing of neural network output may use a checkerboard prediction pattern.

Hybrid neural network based end-to-end image and video coding method

Methods and apparatus are provided for collaborative partition coding for region based filters. An apparatus includes a video encoder () for encoding image data for a plurality of regions in a picture. The video encoder () includes multiple filters for filtering the image data based on region partition information for the plurality of regions. The region partition information for the plurality of regions is shared between the multiple filters.

Methods and apparatus for collaborative partition coding for region based filters

Techniques are described for express and implied signaling of transform mode selections in video coding. Information derived from coefficient samples in a given transform unit (TU) or prediction unit (PU) may constrain or modify signaling of certain syntax elements at the coding block (CB), TU, or PU levels. For instance, based on the spatial locations of decoded coefficients, the spatial patterns of coefficients, or the correlation with the coefficients in neighboring blocks, various syntax elements such as the transform type and related flags/indices or secondary transform modes/flags indices, a residual coding mode, intra and inter prediction modes, and scanning order may be disabled or constrained. In another case, if the coefficient samples match a desired spatial pattern or have other desired properties then a default transform type, a default secondary transform type, a default intra and inter prediction mode or other block level modes may be inferred at the decoder side. Similar ideas may be extended to infer intra-block copy (IBC) flags/modes/indices from coefficient samples, or to infer flags and modes related to predictive coding techniques such as block-wise differential pulse code modulation (BDPCM), i.e., horizontal and vertical BDPCM modes, palette mode syntax and other block level flags/indices.

Coefficient-based transform and mode signaling

In an example method, a decoder obtains a data stream representing video content. The video content is partitioned into one or more logical units, and each of the logical units is partitioned into one or more respective logical sub-units. The decoder determines that the data stream includes first data indicating that a first logical unit has been encoded according to a flexible skip coding scheme. In response, the decoder determines a first set of decoding parameters based on the first data, and decodes each of the logical sub-units of the first logical unit according to the first set of decoding parameters.

Encoding and decoding video content using prediction-aware flexible skip coding

A cross-component based filtering system is disclosed for video coders and decoders. The filtering system may include a filter having an input for a filter offset and an input for samples reconstructed from coded video data representing a native component of source video on which the filter operates. The offset may be generated at least in part from a sample classifier that classifies samples reconstructed from coded video data representing a color component of the source video orthogonal to the native component according to sample intensity.

Enhanced cross component sample offset filtering system for video coding and decoding

Techniques are disclosed for generating virtual reference frames that may be used for prediction of input video frames. The virtual reference frames may be derived from already-coded reference frames and thereby incur reduced signaling overhead. Moreover, signaling of virtual reference frames may be avoided until an encoder selects the virtual reference frame as a prediction reference for a current frame. In this manner, the techniques proposed herein contribute to improved coding efficiencies.

Predictive video coding employing virtual reference frames generated by direct MV projection (DMVP)

A video encoder may transform residual data by using a transform selected from a group of transforms. The transform is applied to the residual data to create a two-dimensional array of transform coefficients. A scanning mode is selected to scan the transform coefficients in the two-dimensional array into a one-dimensional array of transform coefficients. The combination of transform and scanning mode may be selected from a subset of combinations that is based on an intra-prediction mode. The scanning mode may also be selected based on the transform used to create the two-dimensional array. The transforms and/or scanning modes used may be signaled to a video decoder.

Video coding using mapped transforms and scanning modes

Video coders and decoders perform transform coding and decoding on blocks of video content according to an adaptively selected transform type. The transform types are organized into a hierarchy of transform sets where each transform set includes a respective number of transforms and each higher-level transform set includes the transforms of each lower-level transform set within the hierarchy. The video coders and video decoders may exchange signaling that establishes a transform set context from which a transform set that was selected for coding given block(s) may be identified. The video coders and video decoders may exchange signaling that establishes a transform decoding context from which a transform that was selected from the identified transform set to be used for decoding the transform unit. The block(s) may be coded and decoded by the selected transform.

Incremental transform set construction and transform signaling for video coding

Methods and apparatus are provided for encoding and decoding binary sets using adaptive tree selection. In one exemplary encoding method embodiment, picture data is encoded for a block in a picture; in which one of a plurality of trees structures is selected to code a binary set of data for indicating coefficient significance for the block. In another exemplary encoding method embodiment, picture data is encoded for a block in a picture, in which one or more trees are used to encode a binary set of data for indicating significance for the block, the one or more trees each having a plurality of nodes, at least one of the nodes of the one or more trees being modified responsive to at least one parameter.

Methods and apparatus for video encoding and decoding binary sets using adaptive tree selection

Methods and apparatus are provided for improved chroma encoding and decoding. An apparatus includes an encoder for encoding picture data for at least a block in a picture. Multiple partition types are supported for intra chroma coding of the block. The multiple partition types include a set of chroma partition types and a set of luma partition types. The set of chroma partition types are different than the set of luma partition types.

Methods and apparatus for improved intra chroma encoding and decoding

Video coding methods and apparatuses are provided. A set of two or more pictures is coded. The set includes at least a first picture coded with a first spatial resolution, and a second picture coded with a second spatial resolution different from the first spatial resolution. The set of two or more pictures is stored in a decoded picture buffer based on corresponding spatial resolutions. The set of two or more pictures stored in the decoded picture buffer is used as a set of reference pictures for coding one or more successive pictures subsequent to the set of two or more pictures. The set of two or more pictures is incorporated into a reference picture list that contains pictures with at least two different spatial resolutions.

Video coding using multi-resolution reference picture management

Methods and apparatus are provided for signaling intra prediction for large blocks for video encoders and decoders. An apparatus includes a video encoder for encoding picture data for at least one large block in a picture by signaling intra prediction for the at least one large block. The intra prediction is signaled by selecting a basic coding unit size and assigning a single spatial intra partition type for the basic coding unit size. The single spatial intra partition type is selectable from among a plurality of spatial intra partition types. The at least one large block has a large block size greater than a block size of the basic coding unit. The intra prediction is hierarchical layer intra prediction and is performed for the at least one large block by splitting from the large block size to the basic coding unit size.

Methods and apparatus for signaling intra prediction for large blocks for video encoders and decoders

Methods and apparatus are provided for improved entropy encoding and decoding. An apparatus includes a video encoder () for encoding at least a block in a picture by transforming a residue of the block to obtain transform coefficients, quantizing the transform coefficients to obtain quantized transform coefficients, and entropy coding the quantized transform coefficients. The quantized transform coefficients are encoded using a flag to indicate that a current one of the quantized transform coefficients being processed is a last non-zero coefficient for the block having a value greater than or equal to a specified value.

Methods and apparatus for improved entropy encoding and decoding

Growing community of inventors

San Diego, CA, United States of America

Yunfei Zheng