Nokia Technologies Oy

Nokia Corporation

Nokia Technology Oy

Yu You

Sujeet Shyamsundar Mate

Lixin Fan

Emre Baris Aksu

Igor Danilo Diego Curcio

Kimmo Tapio Roimela

Saba Ahsan

Tinghuai Wang

Peter O Fasogbon

Kashyap Kammachi Sreedhar

Ville-Veikko Mattila

Junsheng Fu

Miska Matias Hannuksela

Wolfgang Van Raemdonck

Antti Johannes Eronen

Lukasz Kondrad

Francesco Cricrì

Wendong Wang

Kashyap Kammachi-Sreedhar

Can Feng Chen

Qiang Wu

Jian Zhang

Panu Akerman

Furong Peng

Yali Cai

Mikael Lepistö

Sounak Bhattacharya

Jozsef Szabo

Peter Oluwanisola Fasogbon

The embodiments relate to a method and technical equipment for implementing the method. The method comprises receiving an omnidirectional video; determining a marker identifying a viewport for a client device; determining a region of the omnidirectional video frame based, at least partially, on the viewport; encoding the determined region with a marker for synchronized operation between the client device and a server; packetizing the encoded region; and transmitting the packetized region to the client device.

Method, an apparatus and a computer program product for streaming of immersive video

A method and a network-based media processing source, including: generating a workflow description; generating, for a workflow manager, a container file or a manifest or a bit stream, which container file or manifest or bit stream comprises the workflow description; and including in the workflow description an authentication and authorization descriptor that defines desired authentication methods desired by the network-based media processing source for subsequent authenticating a media source to the workflow manager. The workflow manager performs: receiving from a network-based media processing source a workflow description; and determining, from the container file or a manifest or a bit stream, a workflow description that comprises an authentication and authorization descriptor that indicates desired authentication methods authenticating a media source to the workflow manager.

Method and apparatus for authenticating and authorizing network based media processing

A method comprising obtaining a 360-degree video content from a video source; projecting the 360-degree video content onto a 2D image plane; dividing the projected 360-degree video content into a plurality of regions, wherein the regions are partly overlapping and each region covers a region of the 360-degree video content suitable for a viewport presentation; receiving a request for a viewport orientation of the 360-degree video content from a client; and providing the client with an viewport presentation of the region corresponding to the requested viewport orientation.

Method, an apparatus and a computer program product for video conferencing

There is disclosed an apparatus and a method for spatial computing service session description for volumetric XR conversation. In accordance an embodiment the method comprises receiving volumetric video from a plurality of sources, the volumetric video data comprising color images and depth images representing at least a part of a scene; determining which of the plurality of sources belong to a same group; selecting a group identifier for the group; associating the volumetric video with the group identifier indicative of from which group the volumetric video data is received; associating the volumetric video with a source identifier indicative of from which source of the group the volumetric video data is received; associating the color image of the volumetric video with a color data identifier; and associating the depth image of the volumetric video with a depth data identifier.

Method, an apparatus and a computer program product for spatial computing service session description for volumetric extended reality conversation

In accordance with example embodiments of the invention there is at least one method and apparatus to perform assigning, by a network device, a step descriptor to at least one segment split of a workflow comprising at least one data input instance from at least one network node; and sending at least one sub-flow of the workflow based on the at least one segment split towards at least one queued task for communication processing, wherein the communication processing is based at least on the step descriptor assigned to the at least one segment split.

System and signalling of video splitter and merger for parallel network based media processing

The embodiments relate to a method comprising establishing a three-dimensional conversational interaction with one or more receivers; generating a pointcloud relating to a user and capturing audio from one or more audio source; generating conversational scene description comprising at least a first dynamic object describing a virtual space for the three-dimensional conversational interaction, wherein the first dynamic object refers to one or more objects specific to the three-dimensional conversational interaction, wherein said one or more objects comprises at least data relating to transformable pointcloud; audio obtained from said one or more audio source and input obtained from one or more connected devices controlling at least the pointcloud, wherein said objects are linked to each other for seamless manipulation; applying the conversational scene description into a metadata, and transmitting the metadata with the respective audio in realtime to said one or more receivers.

Method, an apparatus and a computer program product for video encoding and video decoding

Methods and apparatuses are provided to improve streaming of data by providing efficient media ingress and egress. A method may include sending a plurality of stream registration requests for streams to stream data. The method may also include receiving a plurality of stream addresses. The method may further include establishing a plurality of data links with the plurality of transmission endpoints, and establishing a new data link with a new transmission endpoint according to changing conditions affecting a user equipment, while preserving the same data streams for streaming the data.

Dynamic multiple endpoint generation

According to an example aspect of the present invention, there is provided a method, comprising receiving from a source entity a workflow description for network based media processing (), determining encryption requirements on the basis of an encryption descriptor in the workflow description, the encryption descriptor comprising information indicative of one or more encryption methods and at least one prioritized encryption method (), and selecting, on the basis of the encryption descriptor, an encryption method for protecting data for at least one task of a media processing workflow generated on the basis of the workflow description ().

Network based media processing security

An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.

Pose validity for XR based services

An apparatus includes circuitry configured to: process media, the processing having an input and an output; determine a value of a mode to process the data, the value of the mode set to either push or pull; wherein the mode is added to an input descriptor or an output descriptor, and the mode functions with a protocol together in the input descriptor and the output descriptor; determine, for the input, when the value of the mode is set to push, that the data is pushed to the input, otherwise when the value of the mode is set to pull, that the data is pulled with the input; and determine, for the output, when the value of the mode is set to push, that the data is pushed from the output, otherwise when the value of the mode is set to pull, that the data is pulled from the output.

Flexible upstream/downstream support for network-based media processing pipelines

Feature information is received from a client device and describes extended reality scene(s) in an extended reality (ER) environment at the client device. An ER description is formed in an ER description format corresponding to the feature information and is stored. Some of the stored ER description format is provided in a representational format upon request of the client device or other client devices viewing the one or more ER scenes and assisting the positioning of corresponding client devices in the ER environment. A client device captures environmental visual data and generates feature information, describing ER scene(s) in an extended reality environment at the client device, from the environmental visual data, and sends the generated feature information toward a server. A client device can localize itself in a 3D environment of an ER description, and generate ER anchors and objects, link them, and send them to a server.

Network-based spatial computing for extended reality (XR) applications

A user equipment, media control unit, media resource function, or another device or function capable of receiving, manipulating, and transmitting data may be configured to: receive an omnidirectional video; determine a viewport of a user equipment; determining a delivery mode; determine a region of the omnidirectional video based, at least partially, on the determined viewport and the determined delivery mode; encode the determined region; packetizing the encoded region; and transmit the packetized region to the user equipment based, at least partially, on the determined delivery mode.

Viewport dependent delivery methods for omnidirectional conversational video

A method, apparatus and computer program product provide a stream binding mechanism that supports stream data pulling and pushing in a distributed or cloud based streaming environment. The method, apparatus and computer program product receive a stream register message associated with a stream from a streaming entity. The stream register message includes a binding descriptor. The method, apparatus and computer program product transmit a create connection message to a stream broker. The method, apparatus and computer program product transmit an endpoint message including a set of connection parameters of an endpoint to the streaming entity. The method, apparatus and computer program product receive a query for the stream from a stream processing node. And the method, apparatus and computer program product transmit a response to the query to the stream processing node. The response includes a set of connection parameters of the stream broker.

Method and apparatus for stream descriptor binding in a streaming environment

An apparatus configured to, in respect of virtual reality content comprising video imagery configured to provide a virtual reality space wherein a virtual reality view presented to a user provides for viewing of the VR space; based on a comment made by and a virtual location of a commenting-user in the virtual reality space when the comment was made; provide for determination of a point of interest in the virtual reality space, the point of interest identified based on, at least, the virtual location of the commenting-user when the comment was made and semantic analysis of the comment to identify the point of interest surrounding the virtual location to which the comment refers, the point of interest associated with the comment thereby enabling the comment to be overlaid over the virtual reality view of the video imagery.

Apparatus and associated methods

A network apparatus distributes a first plurality of tasks for processing first media content among at least a first slicing window and a second slicing window based on a connection map included in a workflow description from a network based media processing (NBMP) source. The first slicing window includes at least one first task from among the first plurality of tasks and the second slicing window includes at least one second task from among the first plurality of tasks. The network apparatus provisions the first media content to at least a first of the one or more media sinks by deploying the at least one first task to one or more first media processing entities, and deploying the at least one second task to one or more of the first media processing entities in response to receiving an indication that the at least one first task has been deployed successfully.

Growing community of inventors

Kangasala, Finland

Yu You