Nokia Technologies Oy

Nokia Corporation

Ofinno, LLC

Comcast Cable Communications, LLC

Provenance Asset Group LLC

Vinod Kumar Malamal Vadakital

Miska Matias Hannuksela

Kimmo Tapio Roimela

Lauri Ilola

Lukasz Kondrad

Jani Lainema

Sebastian Schwarz

Esmael Hejazi Dinan

Kyungmin Park

Peyman Talebi Fard

Weihua Qiao

Damian Ruiz Coll

SungDuck Chun

Vasily Alexeevich Rufitskiy

Johannes Pystynen

Emre Baris Aksu

Kemal Ugur

Francesco Cricri

Harri Juhani Pekonen

Jussi Vesma

Mika Pesonen

Lauri Aleksi Ilola

Jaakko Keränen

Stephan Wenger

Jaakko Olli Taavetti Keränen

Curcio Igor Danilo Diego

Lauri Iiola

Mate Sujeet Shyamsundar

Jaakko Keranen

Jaakko KERÄNEN

Multiview images may comprise attribute frames and geometry frames. Samples of a geometry frames may comprise depth information corresponding to collocated samples of the attribute frames. Additional edge feature frames may be generated, for the multiview images, with samples of the edge feature frame indicating whether collocated samples of the geometry frames are at edges and/or discontinuities. Information from the edge feature frame may be used to correct quantization errors that may be associated with samples, of the geometry frames, that are located at edges and discontinuities.

Edge feature-assisted processing of multiview images

A wireless device receives, from an SMF, a message for a PDU session establishment, wherein the message comprises a configuration information for determining whether one or more packets are associated with a plurality of packets of a data unit (DU) based on a timestamp field of the one or more packets. The wireless device determines, based on the configuration information, that a first packet, comprising a first timestamp field, is one of a first plurality of packets of a first DU, and a second packet, comprising a second timestamp field, is one of the first plurality of packets of the first DU. The wireless device sends, to a base station, the first packet and the second packet.

Data unit identification

The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (); generating a bitstream comprising an encoded video frame (); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (); and transmitting the encoded bitstream to a storage for rendering (). The embodiments also relate to a technical equipment for implementing the method.

Method, an apparatus and a computer program product for volumetric video encoding and video decoding

A method comprising: providing a 3D representation of at least one object as an input for an encoder (); projecting the 3D representation onto at least one 2D patch (); generating at least a geometry image and a texture image from the 2D patch (); generating, based on the geometry image, a mesh comprising a number of vertices (); mapping the number of vertices to two-dimensional (2D) coordinates of the texture image (), and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream ().

Apparatus, a method and a computer program for volumetric video

A user plane function UPF receives, from a SMF, a DU identification information for identifying a plurality of packets for one or more DUs of an application. The UPF receives a first plurality of packets, of the plurality of packets, of a first DU of the application; and a second plurality of packets, of the plurality of packets, of a second DU of the application. The UPF sends, to an access node and using the DU identification information a first GTP container comprising a first GTP header comprising a first number identifying the first plurality of packets, and a second GTP container comprising a second GTP header comprising a second number identifying the second plurality of packets.

Data unit in wireless system

An example embodiment relates to a method comprising: receiving (), by a client device, information about a scene associated with a 3D presentation for initiating viewport rendering by an application, wherein said scene is hosted by a server as one or more encoded 2D patches, said 2D patches being projections of the 3D representation of the scene; providing () the server with information for selecting 2D patches required to reconstruct at least one segment of the 3D scene as visible in a given viewport; obtaining (), from the server, one or more video bitstreams generated based on the selected 2D patches and related metadata for extracting said 2D patches from said one or more video bitstreams; and rendering (), by the client device, the given viewport as a sub-segment of the 3D representation of the scene based on said one or more 2D patches and the related metadata.

A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.

Signalling of metadata for volumetric video

The various embodiments of the invention relates to a method and a technical equipment for video compression. The method comprises processing volumetric image data comprising a plurality of points; defining a hemisphere () around a surface () normal at each point in the volumetric image; partitioning each of the defined hemispheres spatially into a predefined number of angles (); determining a representative radiance value for each angle of the predefined number of angles () of a defined hemisphere (); generating a matrix () for a point storing the determined representative radiance values; and encoding the generated matrix () for the point for video compression.

Method and technical equipment for encoding and decoding volumetric video

There are disclosed various methods, apparatuses and computer program products for viewing volume signalling of volumetric video. In accordance with an embodiment of a method information of a viewing volume appropriate for viewing a volumetric video is obtained. The viewing volume is examined to determine what geometrical shapes describe the viewing volume. One or more geometrical shapes determined for describing the viewing volume are selected, wherein signalling information for the selected one or more geometrical shapes is constructed.

Apparatus, a method and a computer program for viewing volume signalling for volumetric video

An apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide signal information to identify an atlas identifier on a sample of a volumetric media track, or on the volumetric media track in a multi-track container; wherein the signal information allows a file parser to link volumetric media tracks with different atlas identifiers that originate from a volumetric media elementary stream; and wherein the file parser is able to reconstruct the volumetric media elementary stream based on the signal information and data encapsulated in the multi-track container.

Storage of multiple atlases from one V-PCC elementary stream in ISOBMFF

Apparatuses, methods, and computer programs are disclosed. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: signal a depth start of a patch data unit of a patch of data content based on an identifier of a tile and a patch index; wherein the depth start is used to derive a range of at least one depth value for the patch based on the patch index in a tile having the identifier; and signal a depth threshold of an immersive video extension of the patch data unit; wherein the depth threshold specifies a threshold below which an occupancy value is defined to be unoccupied for the patch based on the patch index.

Adaptive depth guard band

Apparatuses, methods, and computer programs are disclosed to implement six degrees of freedom spatial layout signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: segment a scene of volumetric video into one or more sequences, each sequence comprising one or more sub viewing volumes having one or more bitstream alternatives; generate viewing volume and view point indications within one or more dynamic adaptive streaming over hypertext transfer protocol media presentation description files; generate one or more sub volume scheme uniform resource identifiers for client side instructions to retrieve content; and provide one or more of the sub viewing volumes based on a client selection and request.

Six degrees of freedom spatial layout signaling

An apparatus includes circuitry configured to: receive information to cull one or more sets of components belonging to the same atlas from at least one volumetric video bitstream; wherein the information comprises one or more of: atlas-to-view mapping metadata indicating an association between patches in at least one atlas and at least one view; atlas-to-object mapping metadata indicating an association between at least one object and the at least one atlas; patch atlas metadata within a metadata for immersive video master atlas to indicate sub-bitstream culling based on fine-grained patch visibility culling; or partial access metadata, wherein leveraging the partial access metadata comprises storing each of the at least one atlas in its own track, and providing sample grouping information to indicate culling on a file format level; and cull the one or more sets of components from the at least one volumetric video bitstream, based on the information.

Efficient culling of volumetric video atlas bitstreams

According to an example aspect, there is provided an apparatus comprising at least one processing core, at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processing core, cause the apparatus at least to obtain, using a first image recognition or depth sensing mechanism, first information defining an input space, obtain, using the first or a second image recognition or depth sensing mechanism, second information defining a virtual output area, and cause rendering of sensor information captured from the input space into the virtual output area.

Sensor data conveyance

There are disclosed various methods, apparatuses and computer program products for media encapsulating and decapsulating. In an example method for encapsulating media data, a container file including at least one meta data unit in a media data structure is formed. It may be determined that an offset is relative to a location of the media data structure in the container file, wherein the offset data is formed as a reference to the location of the media data structure in the media data unit. An indication that the offset data is relative to the location of the media data structure is included. In an example method for decapsulating media data, a container file including at least one meta data unit in a media data structure and offset data are received. It may be determined that the offset data is relative to a location of the media data structure in the container file, wherein the offset data is used as a reference to the location of the media data structure to obtain the media data unit.

Growing community of inventors

Tampere, Finland

Vinod Kumar Malamal Vadakital