Nokia Technologies Oy

Huawei Technologies Co., Limited

Lukasz Kondrad

Sebastian Schwarz

Lauri Aleksi Ilola

Emre Baris Aksu

Lauri Ilola

Miska Matias Hannuksela

Kimmo Tapio Roimela

Vinod Kumar Malamal Vadakital

Giovanni Cordara

Imed Bouazizi

Kashyap Kammachi Sreedhar

Sujeet Shyamsundar Mate

Saba Ahsan

Igor Danilo Diego Curcio

Panji Setiawan

Yu You

Onay Urfalioglu

Atanas Boev

Jacek Konieczny

Christoph Bachhuber

Karim Helwani

Patrice Rondao Alface

Bogdan Cihodariu Ionita

Peter O Fasogbon

Nicola Piotto

Aleksei Martemianov

There is disclosed an apparatus and a method for spatial computing service session description for volumetric XR conversation. In accordance an embodiment the method comprises receiving volumetric video from a plurality of sources, the volumetric video data comprising color images and depth images representing at least a part of a scene; determining which of the plurality of sources belong to a same group; selecting a group identifier for the group; associating the volumetric video with the group identifier indicative of from which group the volumetric video data is received; associating the volumetric video with a source identifier indicative of from which source of the group the volumetric video data is received; associating the color image of the volumetric video with a color data identifier; and associating the depth image of the volumetric video with a depth data identifier.

Method, an apparatus and a computer program product for spatial computing service session description for volumetric extended reality conversation

The embodiments relate to methods for encoding and decoding, and technical equipment for the same. The method for encoding obtaining two or more representations of volumetric media content, each of the two or more representations of volumetric media content including multiple media component bitstreams; identifying a relationship between the two or more representations; generating a description file containing a media component description for each media component bitstream; group descriptions grouping the media component descriptions for each media component bitstream; grouping information descriptions providing information on the identified relationship between group descriptions representing representations. The description file is provided to a receiver.

Method, an apparatus and a computer program product for streaming volumetric video content

A method and technical equipment for encoding, where the method comprises at least receiving a video presentation frame, where the video presentation represents a three-dimensional data in the form of mesh data (); separating from the mesh data information on vertices, wherein the information comprises at least connectivity data defining connections between vertices (); determining parameters relating to said connectivity data (); encoding the parameters to a first bitstream as a video component (); and storing the encoded first bitstream for transmission to a rendering apparatus (). In addition to encoding, also decoding is disclosed.

Method, an apparatus and a computer program product for volumetric video encoding and decoding

There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments the method for video encoding comprises obtaining compressed volumetric video data representing a three-dimensional scene or object (); capsulating the compressed volumetric video data into a data structure (); obtaining data of a two-dimensional projection of at least a part of the three-dimensional scene as seen from a certain viewport (); and including the data of the two-dimensional projection into the data structure ().

Apparatus, a method and a computer program for omnidirectional video

A method comprising: authoring a plurality of sets of media tracks comprising at least a first set of media tracks and a second set of media tracks into a media file format, wherein a subset of tracks of the first set comprises alternate data for each other and a subset of tracks of the second set comprises alternate data for each other; and including, in or along a bitstream comprising a media file including or inferring said media tracks, an indication that said subset of tracks of the first set are alternatives to each other and said subset of tracks of the second set are alternatives to each other upon playback of the media tracks.

Apparatus, a method and a computer program for video coding and decoding

An apparatus comprising circuitry configured to: obtain a three-dimensional model comprising at least one patch, at least one geometry component, at least one occupancy component, and zero or more texture components; subsample the at least one geometry component of the at least one patch of a three-dimensional object at occupied positions using a subsampling criterion; define respective search windows around the respective occupied positions; select respective salient points relative to the respective occupied positions within the respective search windows; triangulate the salient points to approximate a shape of the three-dimensional object; detect zero or more triangles that overlap with at least one unoccupied pixel; split the zero or more triangles that overlap with at least one unoccupied pixel until no triangle overlaps with the unoccupied pixels; and add zero or more additional triangles close to a border of the three-dimensional object to generate a resulting mesh signaled to a decoder.

V3C patch remeshing for dynamic mesh coding

The embodiments relate to a method comprising receiving as an input a volumetric video frame comprising volumetric video data (); decomposing the volumetric video frame into one or more patches, wherein a patch comprises a volumetric video data component (); packing several patches, where at least two patches of the several patches comprise a different volumetric video data component with respect to each other, into one video frame (); generating a bitstream comprising an encoded video frame (); signaling, in or along the bitstream, existence of encoded video frame containing patches of more than one different volumetric video data component (); and transmitting the encoded bitstream to a storage for rendering (). The embodiments also relate to a technical equipment for implementing the method.

Method, an apparatus and a computer program product for volumetric video encoding and video decoding

A method comprising: providing a 3D representation of at least one object as an input for an encoder (); projecting the 3D representation onto at least one 2D patch (); generating at least a geometry image and a texture image from the 2D patch (); generating, based on the geometry image, a mesh comprising a number of vertices (); mapping the number of vertices to two-dimensional (2D) coordinates of the texture image (), and signalling said 2D coordinates of the texture image to be applied to the number of vertices of the mesh in or along a bitstream ().

Apparatus, a method and a computer program for volumetric video

Various embodiments provide an apparatus, a method, and a computer program product. The apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: define or utilize file format syntax elements to indicate samples comprising at least one of: one or more description documents, wherein the one or more description documents comprise 3 dimensional information; or one or more updates to at least one description document of the one or more description documents; and define or utilize the file format syntax elements to indicate a relationship between samples containing the one or more description document and update information to the samples.

Method, apparatus and computer program product for signaling information of a media track

The present disclosure provides a an image processing device for providing a plurality of enhanced partial images which together represent an enhanced three-dimensional, 3D, image, wherein each enhanced partial image is a two-dimensional, 2D, image associated with one of a plurality of focal planes. The image processing device includes processing circuitry configured to receive or generate a plurality of initial partial images, which together form an initial 3D image, wherein each initial partial image is a 2D image associated with one of the plurality of focal planes; and to generate, from each of the initial partial images, an enhanced partial image by generating a blurred version of the initial partial image; and blending the initial partial image with the blurred version of the initial partial image.

Device and method for enhancing images

An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: obtain a scene comprising three-dimensional information in the form of point clouds, three-dimensional meshes, two-dimensional projections of three-dimensional information, light sources, animations or any other form considered as a representation or description of three-dimensional content; extract lighting information from the obtained scene; process the extracted lighting information into at least one explicit lighting parameter and/or at least one pre-processed lighting map; and encode the scene with the at least one pre-processed lighting map and/or the at least one lighting parameter in a file format or as a visual volumetric video-based coding bitstream.

Dynamic re-lighting of volumetric video

Apparatuses, methods, and computer programs are disclosed to implement video-based cloud compression model to world signaling. An example apparatus includes at least one processor; and at least one non-transitory memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to perform: provide first signaling information comprising information related to a world domain, wherein the world domain is a point cloud frame that is represented by a number of points in a first volumetric coordinate system; and provide second signaling information comprising information related to a conversion of a model domain to the world domain, wherein the model domain represents the point cloud frame by a number of points in a second volumetric coordinate system.

Video-based point cloud compression model to world signaling information

An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: provide an animation timing extension; wherein the animation timing extension links a graphics library transmission format animation to timed metadata and a metadata track of the timed metadata; wherein the metadata track of the timed metadata is listed with an object associated with moving picture media; and align at least one timeline of the moving picture media with at least one timeline of the graphics library transmission format animation; wherein a sample of the metadata track is used to manipulate an animation event.

Temporal alignment of MPEG and GLTF media

An apparatus may be configured to: transmit, to a client, an indication of one or more request-response overload capabilities; receive, from the client, at least one request for a plurality of media segments based, at least partially, on the indication of the one or more request-response overload capabilities; and transmit, to the client, at least one response comprising the plurality of media segments. The apparatus may be, for example, a media server, an HTTP overload handler, an edge server, a DANE, etc.

Timed media HTTP request aggregation

A method comprising: writing, in a container file, a first video-based point cloud compression (V-PCC) bitstream and a second V-PCC bitstream, wherein said first and second V-PCC bitstreams are associated with a common group based on at least one logical context; writing, in the container file, an indication about the common group between the first V-PCC bitstream and the second V-PCC bitstream; generating a media presentation description (MPD) file with a first representation belonging to a first adaptation set associated with the first V-PCC bitstream and a second representation belonging to a second adaptation set associated with the second V-PCC bitstream; and writing, in the MPD file, at least one information element describing grouping information of the first representation belonging to the first adaptation set and the second representation belonging to the second adaptation set, wherein said information element is provided with at least one attribute indicating that said first and second V-PCC bitstreams are user-switchable alternatives upon rendering.

Growing community of inventors

Munich, Germany

Lukasz Kondrad