Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V.

Dimitri Podborski

Thomas Schierl

Cornelius Hellge

Robert Philipp Skupin

Yago Sánchez De La Fuente

Thomas Wiegand

Karsten Grueneberg

Karsten Grüneberg

Serhan Gül

Peter Eisert

Anna Hilsmann

Gurdeep Singh Bhullar

Yago Sänchez De La Fuente

Jangwoo Son

Video data for deriving a spatially variable section of a scene therefrom as well as corresponding methods and apparatuses for creating video data for deriving a spatially variable section of a scene therefrom and for deriving a spatially variable section of a scene from video data. The video data comprises a set of source tracks comprising coded video data representing spatial portions of a video showing the scene and is formatted in a specific file format and supports the merging of different spatial portions into a joint bitstream through compressed-domain processing.

Merging friendly file format

File format concepts for video files are described. It is proposed to that descriptive data of a file indicates whether a parameter set for a track of a file is forwarded when jointly decoding a sub-stream of the track and a further track, and/or that a file includes, for a sub-stream of a video stream signaled in the file, an alternative parameter set to a parameter set for fully decoding the track, the alternative parameter set being for decoding the sub-stream, so as to allow for switching between multiple tracks of a file, and/or that step-wise stream access pictures of a track of a file are marked as stream access point pictures for accessing the track, and/or that a temporal length within which a decoder refresh in case of a joint decoding of sub-streams distributed over multiple tracks is indicated in a file, and/or that a file provides information from which it is derivable whether a pixel aspect ratio varies.

File format schemes allowing efficient ROI, stream access and parameter set handling

A method of augmenting a view of a real-world environment with a view of a volumetric video object on a user device is disclosed. The method includes determining a current pose information (CPI) indicating a current pose of the view of the real-world environment and a desired pose of the volumetric video object in the real-world environment. The method further includes sending the CPI to a remote server. The method further includes receiving a rendered view of the volumetric video object that has been rendered in accordance with the CPI from the remote server. The method also includes augmenting the view of the real-world environment by at least mapping the rendered view of the volumetric video object onto a planar mapping surface arranged according to the desired position of the volumetric video object.

Augmenting a view of a real-world environment with a view of a volumetric video object

File format concepts for video coding are described. Embodiments allow for an efficient extraction of sub-streams from a video file. Further embodiments allow for a flexible switching between sub-streams of a video file. Further embodiments allow for a flexible handling of decoder initializations.

File format concepts for video coding

Portion- or tile-based video streaming concepts are described.

Portioned video streaming concepts

Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.

Growing community of inventors

Berlin, Germany

Dimitri Podborski