Koninklijke Kpn N.v.

Nederlandse Organisatie Voor Toegepast-natuurwetenschappelijk Onderzoek Tno

Nederlandse Ogranisatie Voor Toegepast-natuurwetenschappelijk Onderzoek Tno

Emmanouil Potetsianakis

Emmanuel Thomas

Alexandre Da Silva Pratas Gabriel

A method of processing video data of a picture is described, the method including: allocating memory for a decoded picture in a decoded picture buffer, DPB, the decoded picture comprising pixels representing video data; receiving a bitstream comprising decoding units, DUs, and storing the DUs in a coded picture buffer, CRB, the DUs representing a coded picture that needs to be decoded into the decoded picture, each of the DUs representing a coded block of pixels; determining if, during decoding of the coded picture, at least one partial output can be performed, the at least one partial output including copying the one or more decoded DUs from the DPB to a data sink, while one or more DUs of the coded picture are not yet decoded and removed the CPB, the one or more decoded DUs representing a part of the decoded picture; and, or performing the at least one partial output if the processor determines that the at least one partial output can be performed, the performing including marking the one or more decoded DUs stored in the DPB as being ready for partial output, the marking signaling the decoder apparatus not to remove the one or more decoded DUs from the DPB; and, copying the one or more marked decoded DUs from the DPB to the data sink without removing the one or more decoded DU from the DPB.

Partial output of a decoded picture buffer in video coding

Methods and apparatus for processing an encoded representation of a sequence of pictures are disclosed, wherein the method includes: allocating memory for a current picture of the sequence of pictures in a decoded picture buffer, DPB; receiving a bitstream comprising an encoded representation of the current picture, and storing the encoded representation as a plurality of decoding units DUs, in a coded picture buffer, CPB, each of the plurality of DUs comprising an encoded set of pixels, wherein no coding dependency exists between coded pixels of different DUs of the current picture; receiving prioritization information associated with each of the plurality of DUs stored in the CPB, the prioritization information defining a decoding order in which the DUs of the current picture are being decoded; decoding one or more of said plurality of DU's into one or more decoded DU's, in accordance with said decoding order, each decoded DU comprising a set of pixels, each set of pixels being associated with a different area in the current picture; storing the sets of pixels in the DPB, a set of pixels being stored at a location in the allocated memory of the DPB that corresponds to a position of the area in the current picture; and, outputting as a partial output, one or more sets of pixels of decoded DUs of the current picture in accordance with the decoding order, while other DUs of the current picture are being decoded or received by the decoding apparatus.

Prioritized decoding and output of parts of a picture in video coding

Methods and apparatus for processing an encoded representation of a sequence of pictures are disclosed, wherein the method includes: a processor of a decoding apparatus allocating memory for one or more pictures in a decoded picture buffer, DPB; the processor receiving a bitstream comprising an encoded representation of a current picture, the encoded representation of the current picture comprising a plurality of decoding units, DUs, each of the plurality of DUs comprising an encoded set of pixels; the processor storing the plurality of DUs of the current picture in a coded picture buffer, CPB; the processor decoding the plurality of DUs into decoded DUs of the current picture and storing the decoded DUs in the allocated memory of the DPB, the processor executing at least one partial output during the decoding of the plurality of DUs of the current picture, the performing of the at least one partial output including: copying one or more of the decoded DUs from the DPB to a data sink before all of the plurality of DUs are decoded, the one or more decoded DUs representing one or more areas of pixels in the current picture; determining output information comprising information about the one or more areas of pixels that are copied to the data sink and information for identifying the current picture; providing access to the output information for use by an application or an application programming interface, API, outside the decoding apparatus.

A method of processing a multi-view video by a client apparatus is described wherein, the multi-view video comprising a set of video streams is created by a set of cameras simultaneously capturing an object in a scene for a set of view angles and for one or more video resolutions, each video stream defining a view associated with a view angle of a camera relative to the object. The method may comprise: receiving a manifest file defining a plurality of windows for the multi-view video, a first window of the plurality of windows defining a first subset of video streams selected from the set of video streams, the first subset of video streams being associated with a first subset of view angles of the set of view angles; determining position information associated with an angular position of a viewer relative to a multi-view display apparatus, the multi-view display apparatus being configured to render the multi-view video identified in the manifest file; selecting the first window from the plurality of windows based on the position information and the first subset of view angles and requesting transmission of the first subset of video streams by a server system; and, receiving multi-view video data associated with the first subset of video streams; and, providing the multi-view video data to a decoder apparatus for decoding.

Growing community of inventors

The Hague, Netherlands

Emmanouil Potetsianakis