Nokia Technologies Oy

Nokia Corporation

Core Wireless Licensing S.a.r.l.

Provenance Asset Group LLC

Microsoft Technology Licensing, LLC

Igor Danilo Diego Curcio

Sujeet Shyamsundar Mate

Emre Baris Aksu

Francesco Cricri

Miska Matias Hannuksela

Saba Ahsan

Yu You

David Leon

Sailesh Kumar Sathish

Viktor Varsa

Peter O Fasogbon

Miikka Lundan

Jussi Artturi Leppänen

Kashyap Kammachi Sreedhar

Ville-Veikko Mattila

Ru-Shang Wang

Antti Johannes Eronen

Rod Walsh

Ari Hourunranta

Jozef Pieter Van Gassel

Harsh Mehta

Kashyap Kammachi-Sreedhar

Kostadin Dabov

Lassi Ilari Väätämöinen

Jani Antero Peltotalo

Marko Antti Juhani Saukko

Toni Paila

Lukasz Kondrad

Imed Bouazizi

Francesco Cricrì

Radu Ciprian Bilcu

Justin Ridge

Lauri Ilola

Victor Popa

Tuomas Virtanen

Elina Elisabet Helander

Varun Singh

Mikko Roininen

Kumar Malamal Vadakital Vinod

Ru Shang Wang

Katariina Jutta Mahkonen

Tuomas Oskari Virtanen

Lassi Illari Vaatamoinen

Marko Anti Juhani Saukko

Jani Peltotalo

A method, apparatus, and computer program product provide for extended margins around a viewport for immersive content. In the context of a method, the method receives panoramic video content and determines at least one motion signal. The method determines a viewport area, margin area, and background area for the panoramic video content based on the at least one motion signal and a quality level for each area. The method causes transmission of a request for updated panoramic video content in accordance with the determined quality levels. The method also receives updated panoramic video content in response to the request and causes rendering of the content for display.

Method, apparatus and computer program product providing for extended margins around a viewport for immersive content

A method comprising obtaining a 360-degree video content from a video source; projecting the 360-degree video content onto a 2D image plane; dividing the projected 360-degree video content into a plurality of regions, wherein the regions are partly overlapping and each region covers a region of the 360-degree video content suitable for a viewport presentation; receiving a request for a viewport orientation of the 360-degree video content from a client; and providing the client with an viewport presentation of the region corresponding to the requested viewport orientation.

Method, an apparatus and a computer program product for video conferencing

There is disclosed an apparatus and a method for spatial computing service session description for volumetric XR conversation. In accordance an embodiment the method comprises receiving volumetric video from a plurality of sources, the volumetric video data comprising color images and depth images representing at least a part of a scene; determining which of the plurality of sources belong to a same group; selecting a group identifier for the group; associating the volumetric video with the group identifier indicative of from which group the volumetric video data is received; associating the volumetric video with a source identifier indicative of from which source of the group the volumetric video data is received; associating the color image of the volumetric video with a color data identifier; and associating the depth image of the volumetric video with a depth data identifier.

Method, an apparatus and a computer program product for spatial computing service session description for volumetric extended reality conversation

An apparatus may be configured to: receive, from a first user equipment, at least one real-time transport protocol header extension configured to handle at least one protocol data unit, wherein the at least one real-time transport protocol header extension comprises, at least, one or more application controlled bits; determine whether the one or more application controlled bits are valid; and set values for one or more network controlled bits of the at least one real-time transport protocol header extension based, at least partially, on a determination of whether the one or more application controlled bits are valid, wherein the one or more application controlled bits comprise bits that do not overlap with the one or more network controlled bits.

Priority application and network bits for PDU handling

The embodiments relate to a method comprising establishing a three-dimensional conversational interaction with one or more receivers; generating a pointcloud relating to a user and capturing audio from one or more audio source; generating conversational scene description comprising at least a first dynamic object describing a virtual space for the three-dimensional conversational interaction, wherein the first dynamic object refers to one or more objects specific to the three-dimensional conversational interaction, wherein said one or more objects comprises at least data relating to transformable pointcloud; audio obtained from said one or more audio source and input obtained from one or more connected devices controlling at least the pointcloud, wherein said objects are linked to each other for seamless manipulation; applying the conversational scene description into a metadata, and transmitting the metadata with the respective audio in realtime to said one or more receivers.

Method, an apparatus and a computer program product for video encoding and video decoding

An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.

Pose validity for XR based services

A method includes generating a bitstream defining a presentation, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline and a second presentation timeline; and indicating in the bitstream a switching mode with respect to the first presentation timeline associated with the first visual media component, or with respect to the second presentation timeline associated with the second visual media component, the switching mode being indicated dependent on a viewpoint of a user; wherein the switching mode provides an indication of switching to the first visual media component or to the second visual media component, the first visual media component corresponding to content captured from a first omnidirectional camera in a first location, and the second visual media component corresponding to content captured from a second omnidirectional camera in a second location.

Method, an apparatus and a computer program product for virtual reality

Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.

Network-based spatial computing for extended reality (XR) applications

A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.

Viewport dependent delivery methods for omnidirectional conversational video

A method, apparatus and computer program product encode, into a media description, a first information item indicative of a first locator for segment metadata for a set of representations. The method, apparatus and computer program product encode, into the media description, one or more representation-specific information items indicative of representation-specific locator for segment media data for one or more representations of the set of representations. The method, apparatus and computer program product cause storage of the media description with the set of representations.

Method and apparatus for late binding in media content

A method, apparatus and computer program product creates a viewpoint position structure for media content. The viewpoint position structure specifies a position of a viewpoint defined in a reference coordinate system and an offset of the reference coordinate system with respect to a geographical reference. The method, apparatus and computer program product cause storage of the viewpoint position structure. An indication may be created as to whether the media content is augmented reality media content. The augmented reality media content may comprise a background that is at least partially transparent. The offset may be determined, within the reference coordinate system, relative to a geomagnetic reference direction, based upon one or more of a viewpoint yaw angle, a viewpoint pitch angle, or a viewpoint roll angle.

Method and apparatus for incorporating location awareness in media content

The invention relates to a solution wherein a bitstream defining a presentation is generated, the presentation comprising an omnidirectional visual media content and a first visual media component and a second visual media component; indicating in the bitstream a first presentation timeline associated with the first visual media component; indicating in the bitstream a second presentation timeline associated with the second visual media component; indicating in the bitstream a switching mode to a second presentation timeline associated with the second visual media component; and indicating in the bitstream, that the switching mode is with respect to the first presentation timeline or to the second presentation timeline.

A method, apparatus and computer program products are provided for capturing omnidirectional video with one or more cameras, streaming the video over a network, and rendering the video on a Head Mounted Display (HMD) and more specifically to a method, apparatus, and computer program product for improving the visual quality of viewport-based omnidirectional video streaming. One example method includes selecting a primary viewport, encoding a first representation that covers the primary viewport, and encoding a second representation that provides a gradual picture quality change from a background viewport to the primary viewport.

Method and apparatus for improving the visual quality of viewport-based omnidirectional video streaming

This specification describes a method comprising: in response to detecting a user switching from viewing multidirectional video content to viewing limited viewport video content corresponding to the multidirectional video content or from viewing limited viewport video content corresponding to multidirectional video content to viewing the multidirectional video content: determining transition content for transitioning between a current viewport associated with the content being viewed and a landing viewport associated with the content to be viewed, the transition content being determined based on the current viewport and the landing viewport, wherein the length of the transition content depends on an angular distance between the current viewport and the landing viewport; and outputting the transition content for display.

Switching between multidirectional and limited viewport video content

Methods, devices and computer program products for facilitating the selection of a sourcing peer in peer-to-peer (P2P) streaming environment are disclosed. These methods allow peers to select candidate source peers in an informed manner with low overhead and minimized complexity. These and other features are accomplished by signalling detailed information regarding the buffer contents to one or more requesting peers. This information includes the presence or absence of requested content segments and a listing of gaps in the requested content segments, which allow the requesting peers to select an appropriate sourcing peer. The selection of a sourcing peer is also effected by considering network connectivity and/or network congestion status between the sourcing and the requesting peers.

Method and apparatus for signaling of buffer content in a peer-to-peer streaming network

Growing community of inventors

Tampere, Finland

Igor Danilo Diego Curcio