Beijing Dajia Internet Information Technology Co., Ltd.

Shuiming Ye

Xianglin Wang

Yi-Wen Chen

Xiaoyu Xiu

Tsung-Chuan Ma

Hong-Jheng Jhu

Bing Yu

Guoxin Jin

Shufei Fan

Yun-fei Zheng

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. A method may include obtain a first reference picture and a second reference picture associated with a video block, wherein the first reference picture is before a current picture and the second reference picture is after the current picture in display order; obtain first prediction samples of the video block from the first reference picture; obtain second prediction samples of the video block from the second reference picture; obtain padded prediction samples, and obtain horizontal and vertical gradient values of the first prediction samples and the second prediction samples based on the padded prediction samples; obtain motion refinements for samples in the video block based on the horizontal and vertical gradient values; and obtain bi-prediction samples of the video block based on the motion refinements.

Methods and apparatuses for prediction refinement with optical flow

A method for video coding is provided. The method includes: determining a signaling of merge modes for deriving motion information of a current block, where the merge modes include: regular merge mode and extended merge modes; and deriving motion information of the current block using the regular merge mode, upon determining that the signaling of merge modes includes a positive signal of regular merge mode.

Methods and apparatuses for signaling of merge modes in video coding

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for coding a video signal. A method includes obtaining a first reference picture and a second reference picture associated with a video block; obtaining first prediction samples of the video block from the first reference picture; obtaining second prediction samples of the video block from the second reference picture; obtaining padded prediction samples, and obtaining horizontal and vertical gradient values of the first prediction samples and the second prediction samples based on the padded prediction samples; obtaining motion refinements for samples in the video block based on the horizontal and vertical gradient values; and obtaining bi-prediction samples of the video block based on the motion refinements.

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for decoding a video signal. The method includes obtaining a first reference picture I associated with a video block, obtaining control point motion vectors (CPMVs) of an affine coding block based on the video block, obtaining prediction samples I(i, j) of the affine coding block, deriving PROF prediction sample refinements of the affine coding block based on the PROF, receiving an LIC flag that indicates whether the LIC is applied to the affine coding block, deriving, and when the LIC is applied, LIC weight and offset based on neighboring reconstructed samples of the affine coding block and their corresponding reference samples in the first reference picture, and obtaining final prediction samples of the affine coding block based on the PROF prediction sample refinements and the LIC weight and offset.

Methods and apparatus for prediction refinement with optical flow

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for encoding a video signal. A method may include obtain a first reference picture and a second reference picture associated with a video block, wherein the first reference picture is before a current picture and the second reference picture is after the current picture in display order; obtain first prediction samples of the video block from the first reference picture; obtain second prediction samples of the video block from the second reference picture; obtain padded prediction samples; obtain horizontal and vertical gradient values of the first prediction samples and the second prediction samples based on the padded prediction samples; obtain motion refinements for samples in the video block based on the horizontal and vertical gradient values; and obtain bi-prediction samples of the video block based on the motion refinements.

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for encoding a video signal. A method includes obtaining a first reference picture associated with a video block in a current picture within the video signal and a first motion vector (MV) from the video block to a reference block; obtaining first prediction samples of the video block generated from samples of the reference block; controlling internal bit-depths of internal prediction refinement with optical flow (PROF) parameters by performing a shift operation; obtaining a prediction refinement value for the first prediction sample based on the horizontal and vertical gradient values and the horizontal and vertical motion differences; obtaining second prediction samples associated with a second MV and a prediction refinement value for a second prediction sample; and obtaining a final prediction sample of the video block based on the first prediction sample, the second prediction sample, and the prediction refinement values.

Methods, apparatuses, and non-transitory computer-readable storage mediums are provided for video decoding. The method includes: constructing, by a decoder, a first merge list comprising a plurality of candidates, based on a merge list construction process for regular merge prediction, wherein each one of the plurality of candidates is a motion vector comprising a List 0 motion vector, or a List 1 motion vector, or both; receiving, by the decoder, a first/second index value to indicate a first/second candidate that is chosen from the first merge list; receiving, by the decoder, a first/second binary flag that is coded using a first/second context-adaptive binary arithmetic coding (CABAC) context modeling method to indicate whether a List 0 motion vector of the first/second candidate or a List 1 motion vector of the first/second candidate is selected for a first PU of the geometric prediction.

Methods and apparatuses for video coding with triangle prediction

An electronic apparatus performs a method of updating a most probable modes candidate list for a current block of video data. The electronic apparatus first identifies a neighboring block located at a predefined location relative to the current block and its associated matrix-based intra prediction mode. The electronic apparatus further determines a regular intra prediction mode corresponding to the matrix-based intra prediction mode for the neighboring block according to a predefined mathematical relationship between regular intra prediction modes and matrix-based intra prediction modes. The electronic apparatus additionally inserts the regular intra prediction mode associated with the neighboring block into the most probable modes candidate list according to a predefined order. If the regular intra prediction mode is signaled in the syntax of a video bitstream including the current block, a video decoder will predict the current block from the reconstructed neighboring block according to the regular intra prediction mode.

Methods and apparatus of video coding using improved matrix-based intra prediction coding mode

Embodiments of the disclosure provide systems and methods for performing occlusion detection in frame rate up-conversion of video data including a sequence of image frames. The method includes determining, by a video processor, whether a target block of a target frame is a potential occlusion block based on at least one of motion vector information or distortion metric information associated with the target block. The target frame is to be generated and interpolated into the sequence of image frames. Responsive to the target block being the potential occlusion block, the method further includes detecting, by the video processor, an occlusion type of the target block. The method additionally includes generating, by the video processor, the target block by performing a motion compensation method adaptively selected based on the occlusion type of the target block.

System and method for occlusion detection in frame rate up-conversion of video data

A computer implemented method for symmetrical motion vector difference (SMVD) mode, apparatus, and a non-transitory computer-readable storage medium are provided. The decoder obtains a first and second reference picture associated with a current video block, a first reference picture list of the current video block, and a second reference picture list of the current video block. The decoder receives motion parameters and calculates a first motion vector associated with the first reference picture by adding the MVD to corresponding motion vector predictor associated with the first reference picture, and calculates a second motion vector associated with second reference picture by subtracting the MVD from corresponding motion vector predictor associated with the second reference picture. The decoder obtains a prediction signal of the current video block by combining the prediction blocks generated based on the first motion vector and the second motion vector.

Methods and apparatus for signaling symmetrical motion vector difference mode

Methods are provided for reducing the computation complexity and on-chip memory requirements as well as the decoding latency introduced by LMCS. In one method, a luma prediction sample is obtained for decoding a luma residual sample, a scaling factor is derived using the luma prediction sample, the scaling factor is used to scale the luma residual sample, and the reconstructed luma sample is calculated by adding the luma prediction sample and the scaled luma residual sample.

Methods and devices for prediction dependent residual scaling for video coding

A bit-depth representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a first reference picture associated with a video block within the video signal and a first motion vector (MV) from the video block in a current picture to a reference block in the first reference picture, obtaining the first prediction samples I(i,j)'s of the video block, controlling internal bit-depths of the internal PROF parameters, obtaining prediction refinement values for the first prediction samples I(i,j)'s based on horizontal and vertical gradient values and horizontal and vertical motion differences, obtaining second prediction samples I'(i,j)'s associated with the second MV and corresponding prediction refinement values for the second prediction samples I′(i,j)'s, and obtaining final prediction samples based on the combination of the first prediction samples I(i,j)'s, second prediction samples I′(i,j)'s, and the prediction refinement values.

Methods and apparatuses are provided for video coding. The method includes: partitioning video pictures into a plurality of coding units (CUs), at least one of which is further partitioned into two prediction units (PUs) including at least one geometric shaped PU; obtaining a first merge list including a plurality of candidates, each including one or more motion vectors; and obtaining a uni-prediction merge list for the geometric shaped PU by selecting the one or more motion vectors directly from the first merge list.

Methods and devices are provided for reducing the decoding latency introduced by LMCS. In one method, one or more luma prediction sample values are selected from an output of a bilinear filter of Decoder-side Motion Vector Derivation (DMVR), the one or more selected luma prediction sample values are adjusted into luma prediction sample values with the same bit depth as an original coding bit depth of an input video, the luma prediction sample values with the same bit depth as the original coding bit depth of the input video are used to derive a scaling factor for decoding one or more chroma residual samples, the scaling factor is used to scale one or more chroma residual samples, and one or more chroma residual samples are reconstructed by adding the one or more scaled chroma residual samples and their corresponding chroma prediction samples.

A bit-width representation method of prediction refinement with optical flow (PROF), apparatus, and a non-transitory computer-readable storage medium are provided. The method includes obtaining a reference picture I associated with a video block within the video signal, obtaining prediction samples I(i,j) of the video block from a reference block in the reference picture I, controlling internal bit-widths of a PROF derivation process for various representation precisions of internal PROF parameters by applying right-shifting to the internal PROF parameters based on different bit-shift values, obtaining prediction refinement values for samples in the video block based on the PROF derivation process being applied to the video block based on the prediction samples I(i,j), and obtaining prediction samples of the video block based on the combination of the prediction samples and the prediction refinement values.

Growing community of inventors

San Diego, CA, United States of America

Shuiming Ye