Fraunhofer-gesellschaft Zur Foerderung Der Angewandten Forschung E.v.

Ge Video Compression, LLC

Karsten Grueneberg

Thomas Schierl

Robert Philipp Skupin

Thomas Wiegand

Cornelius Hellge

Yago Sánchez De La Fuente

Detlev Marpe

Valeri George

Anastasia Henkel

Heiner Kirchhoffer

Yago Sánchez

Yago Sanchez

Dimitri Podborski

Robert Skupin

A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined subarea of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

Concept for picture/video data streams allowing efficient reducibility or efficient random access

File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.

File format schemes allowing efficient ROI, stream access and parameter set handling

The present invention concerns file parsers, file generators encoders, decoders, clients, servers and methods using parameter sets for coded video sequences. Said parameter sets may have decoding parameter information and may be conveyed in-band or out-of band. Some embodiments provide solutions to problems being related with correctly initializing a decoder for decoding coded video sequences in open GOP switching scenarios. Some embodiments may provide for hierarchical track switching levels.

File parser, file generator, encoder, decoder, client, server, and methods using parameter sets for coded video sequences

File format concepts for video coding are described. Embodiments allow for an efficient extraction of sub-streams from a video file. Further embodiments allow for a flexible switching between sub-streams of a video file. Further embodiments allow for a flexible handling of decoder initializations.

File format concepts for video coding

A raw byte sequence payload describing a picture in slices, WPP substreams or tiles and coded using context-adaptive binary arithmetic coding is subdivided into tranches with continuing the context-adaptive binary arithmetic coding probability adaptation across tranche boundaries. Thereby, tranche boundaries additionally introduced within slices, WPP substreams or tiles do not lead to a reduction in the entropy coding efficiency of these entities. However, the tranches are smaller than the original slices, WPP substreams or tiles and accordingly they may be transmitted earlier, i.e. with lower delay, than the un-chopped original entities. According to another aspect combinable with the first aspect, substream marker NAL units are used within a sequence of NAL units of a video bitstream to enable a transport demultiplexer to assign data of slices within NAL units to the corresponding substreams or tiles so as to be able to, in parallel, serve a multi-threaded decoder with the corresponding substreams or tiles.

Coding concept allowing parallel processing, transport demultiplexer and video bitstream

Decoder retrieval timing information, ROI information and tile identification information are conveyed within a video data stream at a level which allows for an easy access by network entities such as MANEs or decoder. In order to reach such a level, information of such types are conveyed within a video data stream by way of packets interspersed into packets of access units of a video data stream. In accordance with an embodiment, the interspersed packets are of a removable packet type, i.e. the removal of these interspersed packets maintains the decoder's ability to completely recover the video content conveyed via the video data stream.

Video data stream concept

A video data stream is rendered reducible in a manner so that the reduction leads to a restriction of pictures of the reduced video data stream to merely a predetermined sub-area of the pictures of the original video data stream and in a manner so that transcoding, such as re-quantization, may be avoided and a conformance of the reduced video data stream relative to the codec underlying the original video data stream be maintained. This is achieved by providing the video data stream with information including an indication of the predetermined subarea and replacement indices for redirecting the indices included by the payload portion so as to refer to, and/or replacement parameters for adjusting the first set of coding parameter settings so as to result in, a second set of coding parameter settings.

Growing community of inventors

Berlin, Germany

Karsten Grueneberg