Nokia Technologies Oy

Saba Ahsan

Sujeet Shyamsundar Mate

Igor Danilo Diego Curcio

Yu You

Emre Baris Aksu

Miska Matias Hannuksela

Igor D Curcio

Ari Hourunranta

Peter O Fasogbon

Lukasz Kondrad

Kashyap Kammachi Sreedhar

Lauri Ilola

Ville-Veikko Mattila

Serhan Gül

Mikael Lepistö

The embodiments relate to a method and technical equipment for implementing the method. The method comprises receiving an omnidirectional video; determining a marker identifying a viewport for a client device; determining a region of the omnidirectional video frame based, at least partially, on the viewport; encoding the determined region with a marker for synchronized operation between the client device and a server; packetizing the encoded region; and transmitting the packetized region to the client device.

Method, an apparatus and a computer program product for streaming of immersive video

The embodiments relate to a method and technical equipment for consumption of omnidirectional visual media content, comprising receiving from a sender a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content; transmitting the presentation on a receiver device; determining a condition when to send viewport orientation information to the sender, wherein the determining is based on at least a distance relating to a moving viewport and a corresponding threshold; when the determined condition is met, generating a packet comprising the viewport orientation information and sending the packet to the sender; and receiving a presentation from the sender to be streamed on the receiver device according to the sent viewport orientation.

Method, an apparatus and a computer program product for video encoding and video decoding

A method, apparatus, and computer program product provide for extended margins around a viewport for immersive content. In the context of a method, the method receives panoramic video content and determines at least one motion signal. The method determines a viewport area, margin area, and background area for the panoramic video content based on the at least one motion signal and a quality level for each area. The method causes transmission of a request for updated panoramic video content in accordance with the determined quality levels. The method also receives updated panoramic video content in response to the request and causes rendering of the content for display.

Method, apparatus and computer program product providing for extended margins around a viewport for immersive content

A method comprising obtaining a 360-degree video content from a video source; projecting the 360-degree video content onto a 2D image plane; dividing the projected 360-degree video content into a plurality of regions, wherein the regions are partly overlapping and each region covers a region of the 360-degree video content suitable for a viewport presentation; receiving a request for a viewport orientation of the 360-degree video content from a client; and providing the client with an viewport presentation of the region corresponding to the requested viewport orientation.

Method, an apparatus and a computer program product for video conferencing

There is disclosed an apparatus and a method for spatial computing service session description for volumetric XR conversation. In accordance an embodiment the method comprises receiving volumetric video from a plurality of sources, the volumetric video data comprising color images and depth images representing at least a part of a scene; determining which of the plurality of sources belong to a same group; selecting a group identifier for the group; associating the volumetric video with the group identifier indicative of from which group the volumetric video data is received; associating the volumetric video with a source identifier indicative of from which source of the group the volumetric video data is received; associating the color image of the volumetric video with a color data identifier; and associating the depth image of the volumetric video with a depth data identifier.

Method, an apparatus and a computer program product for spatial computing service session description for volumetric extended reality conversation

The embodiments relate to methods for encoding and decoding, and technical equipment for the same. The method for encoding obtaining two or more representations of volumetric media content, each of the two or more representations of volumetric media content including multiple media component bitstreams; identifying a relationship between the two or more representations; generating a description file containing a media component description for each media component bitstream; group descriptions grouping the media component descriptions for each media component bitstream; grouping information descriptions providing information on the identified relationship between group descriptions representing representations. The description file is provided to a receiver.

Method, an apparatus and a computer program product for streaming volumetric video content

An apparatus may be configured to: receive, from a first user equipment, at least one real-time transport protocol header extension configured to handle at least one protocol data unit, wherein the at least one real-time transport protocol header extension comprises, at least, one or more application controlled bits; determine whether the one or more application controlled bits are valid; and set values for one or more network controlled bits of the at least one real-time transport protocol header extension based, at least partially, on a determination of whether the one or more application controlled bits are valid, wherein the one or more application controlled bits comprise bits that do not overlap with the one or more network controlled bits.

Priority application and network bits for PDU handling

There is provided generating, at a control device of a media communication session between participant devices, a session description for the communication session, the session description including media stream identifiers and at least one element including an arrangement of the media stream identifiers indicating a background media stream and associated one or more overlay media streams, and sending, by the control device, the session description to the participant devices for indicating the participant devices to associate the background media stream with one or more overlay media streams for rendering a scene with at least three degrees of freedom.

Session description for communication session

Some embodiments relate to a method including obtaining information of available quality features of a sender device for providing omnidirectional visual media content; selecting one or more of the available quality features; and providing an indication of the selected one or more of the available quality features. There is also provided a method including obtaining information of available quality features of a receiver device for processing omnidirectional visual media content; providing an indication of the available quality features; receiving from a sender device indication of available quality features of the sender device among the available quality features of the receiver device; selecting one of the quality features, which are available both in the sender device and in the receiver device; and providing an indication of the selected quality feature.

The embodiments relate to a method including generating a bitstream defining a presentation including an omnidirectional visual media content; encoding into the bitstream a parameter to indicate viewport-control options for viewing the presentation, wherein the viewport-control options includes options controllable by a receiving device and options not-controllable by the receiving device and sending the bitstream to the receiver device; receiving one of the indicated viewport-control options from the receiver device as a response; streaming the presentation to the receiver device; when the response has included an indication on a viewport-control controllable by the receiving device, the method also includes receiving information on viewport definitions from the receiver device during streaming of the presentation and adapting the presentation accordingly; when the response has included an indication on a viewport-control not-controllable by the receiving device, the presentation is streamed to the receiver device according to the viewport-control specified in the response.

The embodiments relate to a method including determining a foreground area covering a viewport of 360-degree video and one or more other areas of 360-degree video, not containing the foreground area in its entirety; concluding a first set of tile streams among available tile streams of the 360-degree video to cover the foreground area; concluding a second set of tile streams among the available tile streams of the 360-degree video, to cover the one or more other areas; and requesting transmission of a first set of portions of the first set of tile streams and a second set of portions of the second set of tile streams, wherein the portions in the first set of portions have a shorter duration that portions in the second set of portions.

Method, an apparatus and a computer program product for video streaming

An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.

Pose validity for XR based services

Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.

Network-based spatial computing for extended reality (XR) applications

A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.

Viewport dependent delivery methods for omnidirectional conversational video

There are disclosed various methods, apparatuses and computer program products for adaptive bitrate control for tiled omnidirectional video. In some embodiments information of a size of a viewport to view omnidirectional video data is received and an orientation of a viewport within the omnidirectional video data is determined. A first set of tiles belonging to the viewport and a second set of tiles outside the viewport are determined. A bitrate is estimated for a full picture using a first quality for the first set, and a second quality for the second set. The determination is repeated for a plurality of viewports. A representative viewport orientation is selected using the estimation results. A plurality of bitrates are estimated for a full picture for the third set of tiles and for the fourth set of tiles; and estimated bitrates and the representative viewport orientation are provided to an adaptive bitrate algorithm.

Growing community of inventors

Espoo, Finland

Saba Ahsan