Ge Video Compression, LLC

Fraunhofer-gesellschaft Zur Foerderung Der Angewandten Forschung E.v.

Fraunhofer-gesellschaft Zur F&#xf6;rderung Der Angewandten Forschung E. V.

Dolby Video Compression, LLC

Philipp Helle

Detlev Marpe

Thomas Wiegand

Heiko Schwarz

Simon Oudin

Martin Winken

Heiner Kirchhoffer

Mischa Siekmann

Tobias Hinz

Jan Stegemann

Benjamin Bross

Jonathan Pfaff

Christian Bartnik

Karsten Suehring

Haricharan Lakshman

Ali Atef Ibrahim Khairat Abdelhamid

Philipp Merkle

Björn Stallenberger

Michael Schäfer

Wojciech Samek

Roman Rischke

Bjoern Stallenberger

Stephan Kaltenstadler

Michael Schaefer

Adam Wieckowski

Dominique Maniry

Michael Schafer

Sebastian Bosse

Jackie Ma

Heiner Kirchhoffeer

Thomas Wiegard

An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.

Coding using matrix based intra-prediction and secondary transforms

Coding schemes for coding a spatially sampled information signal using subdivision and coding scheme for coding a sub-division or a multi tree structure are described, wherein representative embodiments relate to picture and/or video coding applications.

Coding of a spatial sampling of a two-dimensional information signal using sub-division

A method for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode is disclosed. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k)—and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal. The prediction residual signal is used to correct the prediction signal.

Efficient implementation of matrix-based intra-prediction

A block-based decoder is configured to partition a picture of more than one color component and of a color sampling format, according to which each color component is equally sampled, into blocks using a partitioning scheme in which the picture is equally partitioned with respect to each color component. A first color component is decoded in units of the blocks with selecting, for each of intra-predicted first color component blocks, one out of a first set of intra-prediction modes. The first set comprises matrix-based intra prediction modes according to each of which a block inner is predicted by deriving a sample value vector out of neighboring reference samples, computing a matrix-vector product between the sample value vector and a prediction matrix associated with the respective matrix-based intra prediction mode to obtain a prediction vector, and predicting samples in the block inner on the basis of the prediction vector.

MIP for all channels in the case of 4:4:4-chroma format and of single tree

Techniques for block wise encoding and decoding may be applied to encoders, decoders, and methods for encoding or decoding. In one example, there is provided a technique to decode or encode a predetermined block of the picture by assigning, based on a first signalization in the data stream, the predetermined block to a first set or a second set; sorting the assigned set of intra-prediction modes according to intra-prediction modes used for neighboring blocks, neighboring the predetermined block, to obtain a list of intra prediction modes; deriving, for the predetermined block, from the data stream, an index into the list of intra prediction modes; and predicting the predetermined block using an intra prediction mode onto which the index points. The decoder or encoder, if the assigned set is the first set of intra-prediction modes, in sorting the assigned set, uses a second mapping which maps each intra-prediction mode of the second set of prediction modes onto a representative one in the first set of intra-prediction modes.

Affine linear weighted intra predictions

An apparatus for block-wise decoding a picture from a data stream and/or encoding a picture into a data stream, the apparatus supporting at least one intra-prediction mode according to which the intra-prediction signal for a block of a predetermined size of the picture is determined by applying a first template of samples which neighbours the current block onto a neural network. The apparatus may be configured, for a current block differing from the predetermined size, to:

Intra-prediction mode using downsampling for block-wise picture coding

A better compromise between encoding complexity and achievable rate distortion ratio, and/or to achieve a better rate distortion ratio is achieved by using multitree sub-divisioning not only in order to subdivide a continuous area, namely the sample array, into leaf regions, but using the intermediate regions also to share coding parameters among the corresponding collocated leaf blocks. By this measure, coding procedures performed in tiles—leaf regions—locally, may be associated with coding parameters individually without having to, however, explicitly transmit the whole coding parameters for each leaf region separately. Rather, similarities may effectively exploited by using the multitree subdivision.

Inheritance in sample array multitree subdivision

A scalable video decoder is described which is configured to reconstruct a base layer signal from a coded data stream to obtain a reconstructed base layer signal; and reconstruct an enhancement layer signal including spatially or temporally predicting a portion of an enhancement layer signal, currently to be reconstructed, from an already reconstructed portion of the enhancement layer signal to obtain an enhancement layer internal prediction signal; forming, at the portion currently to be reconstructed, a weighted average of an inter-layer prediction signal obtained from the reconstructed base layer signal, and the enhancement layer internal prediction signal to obtain an enhancement layer prediction signal such that a weighting between the inter-layer prediction signal and the enhancement layer internal prediction signal varies over different spatial frequency components; and predictively reconstructing the enhancement layer signal using the enhancement layer prediction signal.

Scalable video coding using inter-layer prediction contribution to enhancement layer prediction

A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.

Multi-hypothesis prediction

A coding efficiency increase is achieved by using a common signalization within the bitstream with regard to activation of merging and activation of the skip mode. One possible state of one or more syntax elements within the bitstream may signalize for a current sample set of a picture that the sample set is to be merged and has no prediction residual encoded and inserted into the bitstream. A common flag may signalize whether the coding parameters associated with a current sample set are to be set according to a merge candidate or to be retrieved from the bitstream, and whether the current sample set of the picture is to be reconstructed based on a prediction signal depending on the coding parameters associated with the current sample set, without any residual data, or to be reconstructed by refining the prediction signal depending on the coding parameters associated with the current sample set by means of residual data within the bitstream.

Picture coding supporting block merging and skip mode

A further coding efficiency increase may be achieved if for a current block of a picture, for which the bit stream signals one of supported partitioning patterns, a reversal of the partitioning by block merging is avoided. In particular, if the signaled one of the supported partitioning patterns specifies a subdivision of the block into two or more further blocks, a removal of certain coding parameter candidates for all further blocks, except a first further block of the further blocks in a coding order, is performed. Particularly, those coding parameter candidates are removed from the set of coding parameter candidates for the respective further block, the coding parameters of which are the same as coding parameters associated with any of the further blocks which, when being merged with the respective further block, would result in one of the supported partitioning pattern. This avoids redundancy between partitioning coding and merging coding.

Picture coding supporting block partitioning and block merging

Techniques for encoding/decoding of video signals are described, e.g. implemented in decoders, encoder, methods and non-transitory storage units storing instructions to perform the methods. A decoder or encoder may be configured to predict a predetermined block of the picture using a plurality of neighbouring samples by reducing the plurality of neighbouring samples to obtain a reduced set of samples values lower, in number of samples, than compared to the plurality of neighbouring samples, subjecting the reduced set of sample values to a linear or affine linear transformation to obtain predicted values for predetermined samples of the predetermined block.

Intra predictions using linear or affine transforms with neighbouring sample reduction

Apparatus configured to derive a set-selective syntax element indicating whether the predetermined block is to be predicted using one of a first set of intra-prediction modes comprising a DC intra prediction mode and angular prediction modes. If the set-selective syntax element indicates that the predetermined block is to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a list of most probable intra-prediction modes. If the set-selective syntax element indicates that the predetermined block is not to be predicted using one of the first set of intra-prediction modes, the apparatus is configured to use a matrix-based intra-prediction mode. The list of most probable intra-prediction modes is formed such that the list of most probable intra-prediction modes is free of the DC intra prediction mode in case of the neighbouring blocks being predicted by any of the angular intra prediction modes.

Coding of intra-prediction modes

Apparatus for decoding a predetermined block () of a picture using intra-prediction, configured to read, from the data stream (), a mode index (), the mode index pointing to one out of a list () of matrix-based intra-prediction modes. Additionally, the apparatus is configured to predict samples () of the predetermined block () by computing a matrix-vector product () between an input vector () derived from reference samples () in a neighborhood of the predetermined block () and a prediction matrix () associated with the matrix-based intra-prediction mode (k) pointed to by the mode index () and associating components () of an output vector () obtained by the matrix vector product () onto sample positions () of the predetermined block. For each matrix-based intra-prediction mode, all entries of the prediction matrix () associated with the respective matrix-based intra-prediction mode are represented by a fixed point representation of a predetermined bit-depth, the predetermined bit-depth being equal for the matrix-based intra-prediction modes. Furthermore, the apparatus is configured to, for each matrix-based infra-prediction mode, compute the matrix vector product () between the input vector () and the prediction matrix () associated with the respective matrix-based infra-prediction mode (k) by performing, for each component of the output vector, a right shift at a number of bits which is equal for the matrix-based intra-prediction modes.

Matrix based intra prediction with mode-global settings

A method, computer program, and apparatus for decoding a predetermined block of a picture using intra-prediction by reading, for each of predetermined intra-prediction blocks, from a data stream, a mode index identifying a matrix-based intra-prediction mode. Samples of each predetermined intra-prediction block are predicted by computing a matrix-vector product between an input vector derived from reference samples and a prediction matrix associated with the identified matrix-based intra-prediction mode (k) and associating components of an output vector obtained by the matrix-vector product onto sample positions of the predetermined block. Further predetermined intra-predicted blocks of the picture are predicted to obtain a prediction signal. A transformation flag is decoded from the data stream using context adaptive binary arithmetic coding, and a prediction residual is decoded and re-transformed using a reverse transformation based on the transformation flag to obtain a prediction residual signal. The prediction residual signal is used to correct the prediction signal.

Growing community of inventors

Berlin, Germany

Philipp Helle