Nokia Technologies Oy

Lauri Ilola

Lukasz Kondrad

Kimmo Tapio Roimela

Vinod Kumar Malamal Vadakital

Sebastian Schwarz

Miska Matias Hannuksela

Emre Baris Aksu

Sujeet Shyamsundar Mate

Kashyap Kammachi Sreedhar

Saba Ahsan

Igor Danilo Diego Curcio

Serhan Gül

Jaakko Olli Taavetti Keränen

Jaakko Keranen

Jaakko KERÄNEN

The embodiments relate to methods for encoding and decoding, and technical equipment for the same. The method for encoding obtaining two or more representations of volumetric media content, each of the two or more representations of volumetric media content including multiple media component bitstreams; identifying a relationship between the two or more representations; generating a description file containing a media component description for each media component bitstream; group descriptions grouping the media component descriptions for each media component bitstream; grouping information descriptions providing information on the identified relationship between group descriptions representing representations. The description file is provided to a receiver.

Method, an apparatus and a computer program product for streaming volumetric video content

An apparatus may be configured to: receive, from a first user equipment, at least one real-time transport protocol header extension configured to handle at least one protocol data unit, wherein the at least one real-time transport protocol header extension comprises, at least, one or more application controlled bits; determine whether the one or more application controlled bits are valid; and set values for one or more network controlled bits of the at least one real-time transport protocol header extension based, at least partially, on a determination of whether the one or more application controlled bits are valid, wherein the one or more application controlled bits comprise bits that do not overlap with the one or more network controlled bits.

Priority application and network bits for PDU handling

The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (); generating a bitstream comprising an encoded video frame (); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (); and transmitting the encoded bitstream to a storage for rendering (). The embodiments also relate to a technical equipment for implementing the method.

Method, an apparatus and a computer program product for volumetric video encoding and video decoding

An example embodiment relates to a method comprising: receiving (), by a client device, information about a scene associated with a 3D presentation for initiating viewport rendering by an application, wherein said scene is hosted by a server as one or more encoded 2D patches, said 2D patches being projections of the 3D representation of the scene; providing () the server with information for selecting 2D patches required to reconstruct at least one segment of the 3D scene as visible in a given viewport; obtaining (), from the server, one or more video bitstreams generated based on the selected 2D patches and related metadata for extracting said 2D patches from said one or more video bitstreams; and rendering (), by the client device, the given viewport as a sub-segment of the 3D representation of the scene based on said one or more 2D patches and the related metadata.

Apparatus, a method and a computer program for volumetric video

Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.

Video-based point cloud compression model to world signaling information

An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.

Temporal alignment of MPEG and GLTF media

A method, apparatus and computer program product are provided to signal and store compressed point clouds in video encoding. The method, apparatus and computer program product may be utilized in conjunction with a variety of video formats. Relative to encoding of compressed point clouds, the method, apparatus and computer program product access a point cloud compression coded bitstream and cause storage of the point cloud compression coded bitstream. The point cloud compression coded bitstream comprises a texture information bitstream, a geometry information bitstream, and an auxiliary metadata bitstream. Relative to the decoding of compressed point clouds, the method, apparatus and computer program product receive a point cloud compression coded bitstream and decode the point cloud compression coded bitstream.

Method and apparatus for storage and signaling of compressed point clouds

An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.

Storage of multiple atlases from one V-PCC elementary stream in ISOBMFF

An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: receive a scene description comprising data associated with a scene; place the data associated with the scene into data buffers and create command buffers; adapt the data placed within the data buffers and synchronize the data within the data buffers with information provided from local media or network media; signal information about the adaptation to update the command buffers that command a renderer; and render the scene using the data within the data buffers and the command buffers.

Method for real time texture adaptation

Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.

Adaptive depth guard band

Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.

Six degrees of freedom spatial layout signaling

An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.

Growing community of inventors

Tampere, Finland

Lauri Ilola