Qualcomm Incorporated

Shumaker & Sieffert, P.a.

Chun-Chi Chen

Marta Karczewicz

Han Huang

Vadim Seregin

Wei-Jung Chien

Zhi Zhang

Yao-Jen Chang

Yan Zhang

Kevin Pascal Andre Reuze

Cheng-Teh Hsieh

Chao-Hsiung Hung

Yu Han

Po-Han Lin

A device for decoding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine that a boundary block of a picture of the video data is bi-directional inter-predicted using a first motion vector and a second motion vector, the boundary block having an edge that touches an edge of the picture; decode the picture, including decoding the boundary block; form a first intermediate padding block using the first motion vector; form a second intermediate padding block using the second motion vector; form a padding block using the first intermediate padding block and the second intermediate padding block; and assign padding values of the padding block to a padding region of the picture neighboring the boundary block on an opposite side of the edge of the picture.

Bi-directional prediction boundary pixel padding with out-of-picture-boundary motion vectors

A video decoder may be configured to determine a motion vector and a motion vector precision for a current block; identify a current block template within the current picture; search within a search area for a final reference block template that corresponds to the current block template, wherein to search within the search area, the one or more processors are further configured to: identify an initial reference block template based on the motion vector, search other reference block templates around the initial reference block template using a step size that is set to an initial step size, and iteratively reduce the step size from the initial step size until the step size is set to a final step size that equals the motion vector precision; determine a prediction block for the current block based on the final reference block template.

Template matching in video coding

An example device for decoding video data includes one or more processors configured to determine merge mode information for a current block, the merge mode information indicating that motion information for a current block is to be predicted using a first predictor motion vector and a second predictor motion vector; determine a first motion vector difference (MVD) for the first predictor motion vector and a second MVD for the second predictor motion vector, the second MVD being different than the first MVD; form a first motion vector equaling a combination of the first motion vector predictor and the first MVD; form a second motion vector equaling a combination of the second motion vector predictor and the second MVD; generate a prediction block using the first motion vector and the second motion vector; and decode the current block using the prediction block.

MMVD merge mode with asymmetric motion vector difference

A video decoder can be configured to determine that a current block of the video data is coded in a bi-prediction inter mode; receive a first syntax element identifying a motion vector predictor from a first candidate list of motion vector predictors; receive a second syntax element identifying a motion vector difference; determine a first motion vector for the current block based on the motion vector predictor and the motion vector difference; determine a second motion vector for the current block from a second list of candidate motion vector predictors based on bilateral matching; and determine a prediction block for the current block using the first motion vector and the second motion vector.

Hybrid inter bi-prediction in video coding

A device for decoding video data comprises one or more processors configured to: obtain a syntax element from a bitstream that includes an encoded representation of the video data; determine, based on the syntax element, that a template-matching tool is enabled; based on the template-matching tool being enabled, applying the template-matching tool to generate a prediction block for a current coding unit (CU) of the video data; and reconstruct the current CU based on the prediction block for the current CU.

High-level syntax control flags for template matching-related coding tools in video coding

Systems and techniques are provided for coding video data. In some examples, a process may include obtaining a first plurality of prediction candidates associated with video data. The process may further include determining a first group of prediction candidates at least in part by applying a first grouping method to the first plurality of prediction candidates. The process may include reordering the first group of prediction candidates and selecting a first merge candidate from the reordered first group of prediction candidates. The process may further include adding the first merge candidate to a candidate list.

Motion vector (MV) candidate reordering

An example device includes memory configured to store the video data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine at least one of a temporal candidate or a history-based candidate and determine at least one non-adjacent candidate, wherein the at least one non-adjacent candidate is from a unit that is not adjacent to a current prediction unit (PU). The one or more processors are configured to determine an advanced motion vector predictor (AMVP) candidate list including the at least one of the temporal candidate or the history-based candidate and the at least one non-adjacent candidate. The at least one non-adjacent candidate is added to the AMVP candidate list after the temporal candidate or before the history-based candidate. The one or more processors are configured to code the current PU based on the AMVP candidate list.

Template matching-based advanced motion vector predictor (AMVP) candidate list construction with non-adjacent candidates and AMVP index signaling

A video encoder and video decoder may determine to enable or disable a template-based inter prediction technique based on whether reference picture resampling or weighted prediction are used. A video encoder and video decoder may determine that a reference picture resampling mode is enabled. determine not to apply a template-based inter prediction technique to the video data based on the reference picture resampling mode being enabled, and code the video data using inter prediction without applying the template-based inter prediction technique.

Interaction between reference picture resampling and template-based inter prediction techniques in video coding

A video decoder may be configured to receive a block of video data that was encoded using a coding mode that includes a search process in one or more reference frames. The video decoder may prefetch reference samples in a fixed search region of at least one reference frame of the one or more reference frames, and decode the block of video data using the coding mode, including performing the search process for the coding mode using the prefetched reference samples.

Searching techniques for template matching for video coding

A device for decoding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a deterministic bounding box from which to retrieve reference samples of reference pictures of video data for performing decoder-side motion vector derivation (DMVD) for a current block of the video data; derive a motion vector for the current block according to DMVD using the reference samples within the deterministic bounding box; form a prediction block using the motion vector; and decode the current block using the prediction block.

Using unrefined motion vectors for performing decoder-side motion vector derivation

An example device for decoding video data includes a memory configured to store video data; and one or more processors configured to: decode data representing an initial motion vector for a current block of the video data, the initial motion vector having integer-motion vector difference (MVD) precision; determine a search range around a reference area identified by the initial motion vector in a reference picture; perform a template matching search process in the search range to identify a best matching region; determine error values for neighboring pixels to the best matching region; use the error values for the neighboring pixels to perform a model-based fractional-pixel motion vector refinement to derive motion vector difference values; apply at least one of the motion vector difference values to the initial motion vector to determine a refined motion vector for the current block; and decode the current block using the refined motion vector.

Model-based motion vector difference derivation and template matching prediction for video coding

An example device includes memory configured to store video data and one or more processors coupled to the memory. The one or more processors are configured to apply a multi-pass DMVR to a motion vector for a block of the video data to determine at least one refined motion vector and decode the block based on the at least one refined motion vector. The multi-pass DMVR includes a block-based first pass, a sub-block-based second pass, and a sub-block-based third pass.

Multi-pass decoder-side motion vector refinement

A method of decoding video data includes determining a plurality of hypotheses of a current block based on a plurality of motion vectors. Each of the plurality of motion vectors is associated with one of the plurality of hypotheses, and each of the plurality of hypotheses is based on a set of samples in a reference picture having a motion vector that identifies a top-left sample of the set of samples. The method includes determining one or more neighboring samples in the same picture as the current block, for each of the plurality of hypotheses, determining respective correlation values between at least one sample of a respective hypothesis and at least one sample of the one or more neighboring samples, determining the motion vector for the current block based on the determined respective correlation values, and reconstructing the current block based on the determined motion vector.

Decoder side motion derivation using spatial correlation

A device for decoding video data includes memory configured to store the video data and processing circuitry. The processing circuitry is configured to determine that a current block of the video data is inter-predicted in a combined inter-intra prediction (CIIP) mode or a geometric partitioning mode (GPM), determine that template matching is enabled for the current block, generate a motion vector for the current block based on template matching; determine a prediction block for the current block based on the motion vector in accordance with the CIIP mode or the GPM, and reconstruct the current block based on the prediction block.

Growing community of inventors

San Diego, CA, United States of America

Chun-Chi Chen