Alibaba (china) Co., Ltd.

Beijing Zitiao Network Technology Co., Ltd.

Alibaba Group Holding Limited

Alibaba Innovation Private Limited

Xinwei Li

Yan Ye

Jie Chen

Ru-Ling Liao

Mohammad Golam Sarwer

Jianfan Zhao

Wenwen Wen

Ru-ling Liao

A VVC-standard encoder and a VVC-standard decoder are provided, implementing derivation of a BCW index according to cost values based on template matching. A template matching cost can be calculated for each among a set of possible BCW weight values, and a BCW weight value yielding a lowest template matching cost among each template matching cost calculated can be selected as a BCW index for a bi-predicted merge candidate. Alternatively, a template matching cost can be calculated for each among a subset of possible BCW weight values based on an inherited BCW weight. Additionally, a merge candidate BCW index can be derived while adjusting template matching cost of an inherited BCW weight from a value calculated according to the VVC standard and ECM specifications, or while adjusting template matching cost of a BCW weight having equal weight from a value calculated according to the VVC standard and ECM specifications.

Deriving bi-prediction with coding unit-level weight indices for merge candidates

An input video or video stream may be obtained or received. The input video or video stream may include a plurality of video frames, and each frame may be divided into a plurality of blocks. A current block of the plurality of blocks may be predicted using a planar mode. Depending on which planar mode is used, different reference samples may be used for predicting a current sample in the current block.

On planar intra prediction mode

Methods for encoding a video sequence into a bitstream and decoding a bitstream to output one or more pictures for a video stream. An exemplary method includes: receiving a video sequence; encoding one or more pictures of the video sequence; and generating a bitstream associated with the encoded pictures, wherein the encoding comprises: predicting chroma samples within a current block based on luma samples corresponding to the chroma samples by a plurality of cross-component residual models (CCRMs).

Cross component prediction

A VVC-standard encoder and a VVC-standard decoder are provided, implementing a residual sign prediction method utilizing a sorting order of residual coefficients and an expanded region of a TB. As sign prediction accuracy is higher for larger transform coefficient levels, a VVC-standard encoder and a VVC-standard decoder sort transform coefficient signs of a TB in a one-dimensional array, based on corresponding QIdx values instead of the residual coefficient level value. The first n signs according to corresponding QIdx values, ordered from largest to smallest, are predicted using a residual sign prediction method, and the rest of the signs are signaled by EP bins. A sign prediction area is also extended, without limitation to an upper-left 4×4 region within the transform block, but to a region up to 32×32 in size; a VVC-standard encoder signals the maximum dimensions of the region to a VVC-standard decoder in syntax structures of the block.

Residual sign prediction of transform coefficients in video coding

A VVC-standard encoder and a VVC-standard decoder are provided, implementing a decoder-side chroma intra prediction mode gradient-based derivation method, which improves coding efficiency of chroma intra prediction, thereby saving on signaling cost. A VVC-standard decoder configures one or more processors of a computing system to derive one of multiple possible chroma intra prediction modes by computing gradients of adjacent luma samples and chroma samples of a current chroma block. With minimal increase in signaling cost, the VVC-standard coding and decoding processes are enhanced to base intra prediction modes for chroma blocks on collocated luma block-adjacent reconstructed luma samples adjacent reconstructed chroma samples, enabling prior computational work done on coding and decoding adjacent blocks to be referenced. In this fashion, coding gains can be achieved in matching texture characteristics of the current chroma block based on a texture gradient including adjacent blocks.

Decoder-side chroma intra prediction mode gradient-based derivation

The present disclosure provides a video generation method, an apparatus, a device, and a storage medium, and the method includes: displaying shooting indication information of storyboard shots corresponding to a target video editing template in response to a trigger operation for the target video editing template, the shooting indication information being configured to indicate shooting modes and/or shooting content features corresponding to the storyboard shots; acquiring user material for the storyboard shots corresponding to the target video editing template, respectively; and generating a target result video corresponding to the target video editing template according to the user material respectively corresponding to the storyboard shots.

Video generation method, apparatus, device, and storage medium

The present disclosure provides a video data processing method for cross-component sample adaptive offset (CCSAO). The method includes determining an index based on a vertical coordinate of a chroma sample within a picture; determining a luma sample based on the index; classifying the chroma sample based on a reconstructed value associated with the luma sample; determining an offset based on the classification; and adding the offset to a reconstructed value associated with the chroma sample.

Methods, apparatus, and non-transitory computer readable medium for cross-component sample adaptive offset

The present disclosure relates to a method, an apparatus, a device and a medium for video editing. The method including: obtaining a plurality of target videos, the plurality of target videos comprising first videos shot and recorded by different user devices for a same recording task; obtaining an editing template corresponding to the plurality of target videos, the editing template comprising display position information of the plurality of target videos and track information of the plurality of target videos; and showing a video editing interface based on the plurality of target videos and the editing template; wherein the video editing interface comprises a preview playback area and an editing track area, images of the plurality of target videos are respectively presented in a display area in the preview playback area that is indicated by respective display position information of the plurality of target videos.

Method, apparatus, device and medium for video editing

During video encoding or decoding, cross-component prediction can be used to predict a chroma sample from collocated reconstructed luma samples. The prediction can be based on a gradient of the collocated reconstructed luma samples, a down-sampled value of the collocated reconstructed luma samples, or a combination thereof. An exemplary method includes: determining a first value associated with a chroma sample, by applying a first gradient pattern to reconstructed values of a first plurality of luma samples; determining a second value associated with the chroma sample, by applying a down-sampling filter to reconstructed values of a second plurality of luma samples; and predicting the chroma sample based on the first value and the second value.

Cross component prediction of chroma samples

The present disclosure relates to a video generating method and apparatus, a device, a storage medium and a program product. The method comprises: acquiring first text information, wherein the first text information is used for describing writing requirements of a video copywriting; generating second text information based on the first text information, wherein the second text information is copywriting information meeting the writing requirements described by the first text information; generating multimedia editing data based on third text information; generating a target video based on the multimedia editing data. Embodiments of the present disclosure provide an efficient one-stop video production scheme, and improve video production efficiency by generating copywriting information meeting the described writing requirements based on the writing requirements describing the video copywriting, and then producing the video according to the generated copywriting information.

Method, apparatus, device, storage medium and program product for video generating

The present disclosure provides intra prediction methods for video or image coding. An exemplary method includes: performing an intra predicting process for a target block, wherein performing the intra predicting process comprises: determining an intra prediction mode for the target block; in response to the intra prediction mode is an angular mode, determining a filtered value by applying an N-tap interpolation filter to a plurality of reference samples surrounding the target block based on the angular mode, wherein N is an integer greater than 4; and determining a predicted value of a sample of the target block based on the filtered value.

Filtering methods for angular intra prediction

A VVC-standard encoder and a VVC-standard decoder implement improvements over VVC and ECM in a number of regards: a temporal motion vector prediction candidate selection method utilizing relocation of a collocated CTU; a temporal motion vector prediction candidate selection method utilizing expanded selection range; a temporal motion vector prediction candidate selection method utilizing unconditional derivation of a scaled motion vector; a temporal motion vector prediction candidate selection method utilizing omission of scaling uni-predicted motion vectors to bi-predicted motion vectors; a temporal motion vector prediction candidate selection method utilizing multiple options in setting a reference picture index; a temporal motion vector prediction candidate selection method utilizing scaling factor offsetting; a merge candidate list building method omitting a temporal motion vector prediction candidate; and a picture reconstruction method utilizing motion information refinement.

Temporal merge candidates in merge candidate lists in video coding

A video data processing method includes receiving a bitstream; decoding an index associated with a coding unit based on the bitstream, the index indicating a selection mode among at least four selection modes; determining whether a plurality of top neighboring samples and a plurality of left neighboring samples are available; determining four samples based on the index; determining two parameters based on the four samples; determining predicted samples of the coding unit based on the two parameters; and decoding the coding unit based on the predicted samples; wherein determining the four samples based on the index further comprises: determining the four samples based on an availability of the plurality of the top neighboring samples and the plurality of the left neighboring samples.

Systems and methods for liner model derivation

A video processing method includes: determining whether an inter predictor correction is enabled for a coding block; and when the inter predictor correction is enabled for the coding block, performing the inter predictor correction by: obtaining a plurality of predicted samples from a top boundary and a left boundary of a predicted block corresponding to the coding block; obtaining a plurality of reconstructed samples from top neighboring reconstructed samples and left neighboring reconstructed samples of the coding block; and deriving a corrected predicted block based on the plurality of the predicted samples, the plurality of the reconstructed samples and the predicted block.

Growing community of inventors

Beijing, China

Xinwei Li