Tencent America LLC

Rohit Abhishek

Arianne Hinds

Iraj Sodagar

Stephan Wenger

Paul Spencer Dawkins

Byeongdoo Choi

Shuai Zhao

A system and method for split rendering immersive media using proxy edge cloud computing architecture. The system and method may include dynamically determining a task-split or splitting a task for rendering a scene in an immersive media stream into two or more computational tasks based on one or more processing delays, wherein the task-splitting splits the scene into first part including one or more first tasks performed by an edge computing system and second part including one or more second tasks performed by a cloud computing system. The system and method may include transmitting the first parts of the scene, and transmitting the second parts of the scene.

Split rendering for lightfield immersive media using proxy-edge-cloud architecture

A method including parsing a scene file to extract relevant scene file data; sending the relevant scene file data to a converter; translating, by the converter, the relevant scene file data into a format compatible with a respective rendering engine; mapping the translated scene file data using the respective rendering engine into a scene representation, wherein the scene representation is compatible with an Immersive Technologies Media Format (ITMF).

Mapping architecture of immersive technologies media format (ITMF) specification with rendering engines

A method for receiving, by a plurality of user devices within a Local Area Network (LAN), a request to create a local cloud within the LAN, selecting, by one of the plurality of user devices, a master device from among the plurality of user devices, and one or more devices from among the plurality of user devices based on a resource availability, requesting, by the master device, each of the one or more devices to share resources of the device for the local cloud, and configuring, by the master device, the one or more devices as the local cloud. The master device receives a service request for a service to be performed by the local cloud, and distributes a plurality of tasks corresponding to the service to the one or more devices configured as the local cloud according to the resource availability of the one or more devices.

Method and apparatus for using local area network as service for edge cloud

Method, device, and non-transitory storage medium for generating crowdsourced holographic views are provided. The method may include receiving one or more images of a same scene from one or more imaging devices, where each of the one or more imaging devices is at different locations. The method may further include generating a 3D model of the same scene based on the one or more images and streaming immersive media for rendering a holographic display of the same scene based on the 3D model based on determining that a display device is capable of displaying immersive media.

Generating holographic or lightfield views using crowdsourcing

A method and device for signaling multiple audio mixing gains in a teleconference using a single Real-time Transport Protocol (RTP) header extension is provided. The method includes receiving an input audio stream from a 360-degree video/audio stream that includes multiple mixing gains from the input audio stream and overlay audio stream, declaring a single RTP header extension (including one or more of an element identifier, a length of an extension element, and a magnitude of the mixing gains) for all the mixing gains, and signaling the mixing gains using the single RTP header extension. The single RTP header extension may use a one-byte or two-byte header extension format which is declared using a Session Description Protocol (SDP).

Techniques for signaling multiple audio mixing gains for teleconferencing and telepresence for remote terminals

Analyzing the complexity of an object of a scene in a media steam (or media data) performed by at least one processor, is provided, including receiving immersive media data comprising a plurality of scenes from a content source; obtaining a respective object of a respective scene in the plurality of scenes, from the immersive media data; analyzing the respective scene to generate complexity information associated with the respective object of the respective scene; generating metadata associated with the respective object of the respective scene, the metadata comprising the complexity information; and determining whether to distribute the respective scene to a client for processing based on the generated metadata.

Immersive media data complexity analyzer for transformation of asset formats

Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for processing media streams. An apparatus includes processing circuitry that sends a message to a media aware network element that is configured to process a plurality of audio streams of a conference call. The message indicates that the plurality of audio streams is to be down mixed by the media aware network element. The processing circuitry receives the down mixed plurality of audio streams from the media aware network element and decodes the down mixed plurality of audio streams to receive the conference call.

Recommending audio mixing parameters by audio stream sender

A method, computer program, and computer system for video conferencing is provided. Video data associated with an immersive teleconferencing session is received. A parameter associated with the video data is identified, whereby the parameter specifies overlay data associated with the immersive teleconferencing session. The video data is displayed with one or more overlays based on the identified parameter.

Parameters for overlay handling for immersive teleconferencing and telepresence for remote terminals

Method, device, and non-transitory storage medium for adaptive streaming of immersive media are provided. The method may include determining characteristics associated with a scene to be transmitted to the end client, adjusting at least a part of the scene to be transmitted to the end client based on the determined characteristics, and transmitting an adaptive stream of the lightfield or holographic immersive media comprising the adjusted scene based on the determined characteristics.

Adaptive streaming for lightfield or holographic media

Packaging media for optimizing immersive media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation; acquiring asset information associated with media assets corresponding to a set of scenes included in the immersive media data for the immersive presentation; analysing characteristics of the media assets based on the asset information, the characteristics comprising an asset type associated with a respective media asset and a frequency that indicates a number of times the respective media asset is used among the set of scenes included in the immersive presentation; ordering the media assets in a sequence based on the asset type and the frequency associated with each of the media assets; and streaming the immersive media data for the immersive presentation based on the ordered sequence of the media assets.

Immersive media streaming prioritized by frequency of asset reuse

A method for packaging media for optimizing media distribution in a media streaming network may be provided. The method may include: receiving, by a media streaming server, an immersive media stream comprising one or more immersive media assets associated with one or more scenes; identifying a subset of the one or more immersive media assets that comprise essential elements of a respective scene; ordering the one or more immersive media assets in a sequence, based on the identified subset of the one or more immersive media assets that comprise essential elements of a respective scene in the one or more scenes; and streaming the one or more immersive media assets in the ordered sequence from the media streaming server to a client device.

Immersive media streaming prioritized by asset complexity

A method is performed by a network node connected to one or more additional network nodes via a local area network (LAN). The network node and the one or more additional network nodes form a cloud. The method includes setting a first timer to a first value, the first timer being associated with determining whether one of the one or more additional network nodes is an active controller in the cloud. The method includes starting the first timer. The method includes determining, before the first timer expires, whether a first message that indicates the one of the one or more additional network nodes is the active controller is received. Based on determining the first message is received before the first timer expires, the method includes synchronizing with the one of the one or more additional network nodes that is the active controller, and restarting the first timer.

Method and apparatus for using nonstop controller with local area network (LAN) for local cloud

Optimizing media distribution of a media steam performed by at least one processor, is provided, including: receiving immersive media data for an immersive presentation from a content source; acquiring asset information corresponding to media assets in a set of scenes included in the immersive media data; analyzing characteristics of the media assets, from the asset information, used in the set of scenes to determine whether a respective media asset is unique among the media assets; and generating metadata information that uniquely identifies the respective media asset for reusing the respective media asset in the set of scenes, based on determining that the respective media asset is not unique among the media assets in the set of scenes included in the immersive media data for the immersive presentation.

Immersive media analyzer for reuse of scene assets

A method and system for audio mixing in a teleconference using a Session Description Protocol (SDP) and Real-time Transport Protocol (RTP) signaling of audio mixing gain is provided. The method includes receiving an input audio stream from a 360-degree video/audio stream that includes an audio mixing gain which includes audio gain from the input audio stream and audio gain from overlay audio streams, declaring a RTP header extension for the input audio stream using the SDP, the RTP header extension, and signaling the audio mixing gain based on a single attribute of the SDP using the RTP header extension. An element of the RTP header extension may include an element identifier, a length of an extension element, and a magnitude of the audio mixing gain of the RTP header extension. The RTP header extension may use a one-byte or two-byte header extension format which is declared using the SDP.

Techniques for signaling audio mixing gain in teleconferencing and telepresence for remote terminals

A method of decoding viewport bitstreams includes decoding first video content; transmitting, information about (i) a speed of a user's head movement while viewing the first video content and (ii) an available bandwidth; receiving a streaming bitstream that includes (i) a first coded video bitstream having a segment size defined for a viewport based on the available bandwidth and a head speed threshold corresponding to the speed of the user's head movement such that the segment size is inversely proportional to the speed of the user's head movement, the first coded video bitstream having a first resolution, and (ii) a second coded video bitstream having a second resolution corresponding to a background having a constant segment duration or size, the second resolution being lower than the first resolution; and rendering second video content using the first coded video bitstream and the second coded video bitstream.

Growing community of inventors

San Jose, CA, United States of America

Rohit Abhishek