Tencent America LLC

Other

Iraj Sodagar

Rohit Abhishek

Shan Liu

Byeongdoo Choi

Shuai Zhao

Stephan Wenger

Sehoon Yea

Arash Vosoughi

Method, apparatus, and system for haptic signal processing are provided. The process may include receiving haptic data in an interchange (HJIF) format based on JavaScript Object Notation (JSON) and receiving a moving picture experts group haptics (MPEG_haptics) object associated with a global haptic experience, the MPEG haptics object in the HJIF format comprising a plurality of reset point timestamps. The process may include rendering effects based on the haptic data in the HJIF format; and may include resetting an output of a renderer based on determining that a current timestamp associated with the global haptic experience is equal to a reset point timestamp in the MPEG haptics object.

Methods for signaling random access in haptics interchange file format

There is included a method and apparatus comprising computer code configured to cause a processor or processors to obtain a request from a network based media processing (NBMP) client to an NBMP workflow manager, transmit a response from the workflow manager to the client, obtain a second request from the client to the workflow manager, control the NBMP workflow manager to set at least one parameter of a NBMP workflow based on the second request, and to control the media content to be processed using the NBMP workflow, the at least one parameter being of any of a scaling scheme and a scheduling scheme, and the requests regard capabilities requested from the workflow manager.

Tailored scheduling of NBMP media workflows based on the platform capabilities

This disclosure relates to an edge-enabled Fifth Generation Media Streaming (5GMS) system that includes a user device that transmits an edge application server (EAS) discovery request including at least one of: a service key performance indicator, a service area, a service availability schedule, or a service continuity scenario. An edge data network responds to the discovery request by identifying one or more available EASs that satisfy the discovery request. The disclosure also relates to a 5GMS application provider that communicates with a 5GMS application function (AF) and/or an edge enabler server (EES) to obtain a list of activated EASs and/or EAS profiles of the activated EASs. The 5GMS application provider may use different interfaces to obtain the list and the EAS profiles.

Edge application server discovery and identification of activated edge application servers and associated profiles

In a method for processing a network-based media processing (NBMP) workflow, workflow information is received. The NBMP workflow to process input data is generated based on the workflow information. The NBMP workflow includes a plurality of media processing tasks and a first buffering task. The plurality of media processing tasks includes a first media processing task and a second media processing task. The first media processing task is set to a running state in which a subset of the input data is processed by the first media processing task and output to the first buffering task as first processed subset data. The first media processing task is set from the running state to a non-running state in response to an amount of the first processed subset data stored in the first buffering task being equal to a first threshold. Further, the second media processing task is set.

Method and apparatus for a step-enabled workflow

A method of managing capabilities of a media streaming network using at least one processor, including receiving a capability request for media streaming capabilities of an edge data network (EDN); determining the media streaming capabilities of the EDN; transmitting a capability response based on the determined media streaming capabilities; receiving a media processing workflow request based on the capability response; establishing a media streaming session according to the media processing workflow request; and streaming media content based on the media streaming session.

Methods for discovery of media capabilities of 5G edge

A method and apparatus for providing video content in a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) streaming session may be provided. The method may include obtaining a pre-session-based description (PreSBD) information of the DASH streaming session instructing a PreSBD client to generate customized session-based description (SBD) document uniform resource locator (URL) for a plurality of SBD descriptors of the DASH streaming session. The method may further include instantiating the PreSBD client and passing PreSBD descriptor information. Then, the method may include controlling generation of a customized SBD document URL associated with a first SBD descriptor from the plurality of SBD descriptors of the DASH streaming session. The method may further include launching a first SBD client based on the customized SBD document URL and passing the first SBD descriptor.

Session-based description URL customization using the session-based dash operations

A method and apparatus may be provided for dynamically signaling picture-in-picture video during media streaming. The method may include determining whether video data comprises a first main video stream and a second picture-in-picture video stream based on a first role value associated with the first main video stream and a second role value associated with the second picture-in-picture video stream; determining a preselection descriptor indicating that the second picture-in-picture video stream is selected to be signaled with the first main video stream in the DASH media streaming; merging the first main video stream with the second picture-in-picture video stream as a combined video stream using the preselection descriptor; and updating the preselection descriptor using an update media presentation descriptor (MPD).

Method and apparatus for dynamic dash picture-in-picture streaming

A method is provided. The method includes generating, by a 5generation media streaming (5GMS) application provider, an edge configuration resource including at least one edge enabler client (EEC) capability specification, transmitting, by the 5GMS application provider, a request for provisioning an edge application server (EAS) to operate as a 5GMS application server (AS), the request including the edge configuration resource, and selecting, by the 5GMS application provider, the EAS to operate as the 5GMS AS based on the EAS being capable of performing the at least one EEC capability specification included in the edge configuration resource.

Method for edge application server discovery or instantiation by an application provider to run media streaming and services on 5G networks

A method includes segmenting a multidimensional media stream into a plurality of segments of multidimensional media in a multidimensional space; representing each segment of the plurality of segments of multidimensional media using a respective sequence vector, the respective sequence vector comprising one or more predefined multidimensional metadata, wherein the predefined multidimensional metadata includes a startcode that is an identical unique code point and a sequence number, wherein each segment includes the identical unique code point; and deriving a network based media processing (NBMP) workflow based on the respective sequence vector of each segment of the plurality of segments.

Multidimensional metadata for parallel processing of the segmented media data

Aspects of the disclosure provide methods, apparatuses, and non-transitory computer-readable storage mediums for receiving media data. One apparatus includes processing circuitry that receives a timed metadata track of a plurality of segments including a plurality of metadata samples. A duration of each of the plurality of segments is equal to a duration of a metadata sample included in the respective segment. A correct timing of each of the plurality of metadata samples is maintained during fragmentation and defragmentation processes that are performed on the timed metadata track. The processing circuitry determines a presentation time of one of the plurality of metadata samples. The processing circuitry processes event information included in one or more event message boxes included in the one of the plurality of metadata samples based on the presentation time of the one of the plurality of metadata samples.

Event information in a timed metadata track

A method, computer program, and computer system are provided for asynchronous media request processing. Based on receiving a first function call requesting performance of a first function corresponding to a resource, a status code is returned, and the first function is performed. Then, after performance of the first function, based on receiving a second function call requesting updating of the resource corresponding to the first function, results of performing the first function are returned. In this manner, a response to the first function call is provided asynchronously based on receiving the second function call.

Asynchronous workflow for cloud based processing

Method, apparatus, and system for encoding or decoding media are provided. The process may include obtaining a track group entry box from an ISO base media file format (ISOBMFF) track associated with a video data. It may also include obtaining a first track among the one or more tracks in the CMAF switching set associated with the video data that has a first alternative group parameter and obtaining a second track associated with the video data that has a second alternative group parameter. The second alternative group parameter and the first alternative group parameter may have a same value. The process may also include decoding the video data based on the first track or the second track in the CMAF switching set.

Method and apparatus for signaling CMAF switching sets in ISOBMFF

A method and device for signaling multiple audio mixing gains in a teleconference using a single Real-time Transport Protocol (RTP) header extension is provided. The method includes receiving an input audio stream from a 360-degree video/audio stream that includes multiple mixing gains from the input audio stream and overlay audio stream, declaring a single RTP header extension (including one or more of an element identifier, a length of an extension element, and a magnitude of the mixing gains) for all the mixing gains, and signaling the mixing gains using the single RTP header extension. The single RTP header extension may use a one-byte or two-byte header extension format which is declared using a Session Description Protocol (SDP).

Techniques for signaling multiple audio mixing gains for teleconferencing and telepresence for remote terminals

A method of processing media content in Moving Picture Experts Group (MPEG) Network Based Media Processing (NBMP) includes obtaining a plurality of tasks for processing the media content, providing an interface between an NBMP workflow manager and a cloud manager by providing an NBMP Link application program interface (API), which links the plurality of tasks together, identifying an amount of network resources to be used for processing the media content, by using the NBMP Link API, and processing the media content in accordance with the identified amount of network resources.

Interoperable cloud based media processing using dynamic network interface

A method includes determining that a split management session is provisioned over a first split-rendering interface that is an extension of a M1 interface; receiving, over a second split-rendering interface that is an extension of a M4 interface, a request to split the one or more client media functions of the UE; and negotiating, over the second split-rendering interface between a split-rendering client of the UE and a split-rendering function of the 5GMS AS, a splitting of the one or more media functions, wherein the negotiating is based on (i) one or more client media capabilities of the UE determined using a third split-rendering interface and (ii) one or more network capabilities of the 5GMS AS determined using a fourth split-rendering interface between the split-rendering function and a function on the 5GMS AS indicating the one or more network capabilities.

Growing community of inventors

Los Angeles, CA, United States of America

Iraj Sodagar