Tencent America LLC

Other

Iraj Sodagar

Rohit Abhishek

Shan Liu

Byeongdoo Choi

Shuai Zhao

Stephan Wenger

Sehoon Yea

Arash Vosoughi

Method, apparatus, and system for haptic signal processing are provided. The process may include receiving a bitstream comprising one or more haptic channels one or more moving picture experts group (MPEG) immersive haptics stream (MIHS) units may be obtained for the one or more haptic channels, with a MIHS unit including timing information for one or more haptic effects. The process may also include timing information being obtained for the one or more haptic effects from the one or more MIHS units, the timing information for the one or more haptic effects including an offset associated with the one or more haptic effects. The one or more haptic effects may be rendered based on the obtained timing information.

Method and apparatus for defining frames and timed referenced network abstraction layer (NALS) structure in haptics signals

A method of signaling a haptic java script object notation (JSON) interchange file format (HJIF) file comprises processing the HJIF file into a binary file format for distribution in a bitstream, in which the HJIF file comprises a plurality of haptic channels, in which each haptic channel from the plurality of haptic channels is defined by a channel description that comprises a relative position parameter that specifies a relative position of a keyframe included in the data and a haptic position parameter of a haptic effect, in which the relative position parameter and the haptic position parameter are specified in accordance with a scale, and in which the haptic effect and keyframe of each channel are synchronized with video or audio included in the bitstream based on the scale.

Method and apparatus for frame-accurate haptics interchange file format

A method is provided. The method includes selecting a standalone augmented reality (STAR) media content including a scene for transmission over a 5G media streaming (5GMS) network, creating, in an outer session loop, an augmented reality (AR)/mixed reality (MR) session for streaming the STAR media content, rendering, in an inner session loop within the outer session loop, the STAR media content, and updating, in the outer session loop, the scene with a new scene by providing the new scene to the inner session loop while the inner session loop renders the STAR media content.

Methods for providing light 5G AR/MR devices by running AR/MR processing on 5G edge servers/cloud including simplified dynamic scene updates

A method for event-driven provisioning of edge servers in a 5G Media Streaming (5GMS) architecture, including setting, by a 5GMS AP, during provisioning or updating of a first EAS one or more event trigger conditions and determining, by a 5GMS AF at the first EAS, based on an indicator event associated with the first EAS, that at least one of the one or more event trigger conditions of the first EAS is satisfied. Generating, by the 5GMS AP, a trigger event in response and setting, by the 5GMS AP, during the provisioning or updating of a second EAS, one or more activating conditions for activating the second EAS. The 5GMS AP determining that the generated trigger event is associated with at least one of the activating conditions for activating the second EAS; and transmitting a message causing activation of the second EAS.

Event-driven provisioning of new edge servers in 5G Media Streaming architecture

A method and apparatus for scaling a Network Based Media Processing (NBMP) workflow on a cloud platform. The method includes obtaining an input workflow including input media stream, determining at least one of scaling type information or transition type information for the input work flow; generating a updated workflow based on the determined at least one of the scaling type information or the transition type information and processing the updated workflow.

Method and apparatus for switching or updating partial or entire workflow on cloud with continuity in dataflow

A including receiving a first video input corresponding to a 360-degree video; receiving one or more second video inputs; defining one or more occlude-free regions in the first video input, each occlude-free region indicating an area of the video that is not overlayed by another image or video; signaling location information of the one or more occlude-free regions in a session description protocol (SDP) via a 3rd Generation Partnership Project (3GPP) overlay attribute, wherein the 3GPP overlay attribute signals whether a respective 3GPP overlay is intended for a occlude-free area or dedicated to a specific overlay; transmitting the SDP to a receiver; and rendering an output video that includes the first video input with the one or more second video inputs overlaid in a region not including the one or more occlude free regions.

Session description protocol (SDP) signaling of occlude-free regions in 360 video conferencing

A method is provided. The method includes selecting media content including a full scene description, selecting a 5generation (5G) media streaming downlink (5GMSd) application server (AS) to stream the media content based on the full scene description, deriving a simplified scene description based on the full scene description, and creating an augmented reality (AR)/mixed reality (MR) session based on the simplified scene description.

Method for streaming dynamic 5G AR/MR experience to 5G devices with updatable scenes

Method, apparatus, and system for haptic signal processing are provided. The process may include receiving haptic data in an interchange (HJIF) format based on JavaScript Object Notation (JSON) and receiving a moving picture experts group haptics (MPEG_haptics) object associated with a global haptic experience, the MPEG haptics object in the HJIF format comprising a plurality of reset point timestamps. The process may include rendering effects based on the haptic data in the HJIF format; and may include resetting an output of a renderer based on determining that a current timestamp associated with the global haptic experience is equal to a reset point timestamp in the MPEG haptics object.

Methods for signaling random access in haptics interchange file format

There is included a method and apparatus comprising computer code configured to cause a processor or processors to obtain a request from a network based media processing (NBMP) client to an NBMP workflow manager, transmit a response from the workflow manager to the client, obtain a second request from the client to the workflow manager, control the NBMP workflow manager to set at least one parameter of a NBMP workflow based on the second request, and to control the media content to be processed using the NBMP workflow, the at least one parameter being of any of a scaling scheme and a scheduling scheme, and the requests regard capabilities requested from the workflow manager.

Tailored scheduling of NBMP media workflows based on the platform capabilities

This disclosure relates to an edge-enabled Fifth Generation Media Streaming (5GMS) system that includes a user device that transmits an edge application server (EAS) discovery request including at least one of: a service key performance indicator, a service area, a service availability schedule, or a service continuity scenario. An edge data network responds to the discovery request by identifying one or more available EASs that satisfy the discovery request. The disclosure also relates to a 5GMS application provider that communicates with a 5GMS application function (AF) and/or an edge enabler server (EES) to obtain a list of activated EASs and/or EAS profiles of the activated EASs. The 5GMS application provider may use different interfaces to obtain the list and the EAS profiles.

Edge application server discovery and identification of activated edge application servers and associated profiles

In a method for processing a network-based media processing (NBMP) workflow, workflow information is received. The NBMP workflow to process input data is generated based on the workflow information. The NBMP workflow includes a plurality of media processing tasks and a first buffering task. The plurality of media processing tasks includes a first media processing task and a second media processing task. The first media processing task is set to a running state in which a subset of the input data is processed by the first media processing task and output to the first buffering task as first processed subset data. The first media processing task is set from the running state to a non-running state in response to an amount of the first processed subset data stored in the first buffering task being equal to a first threshold. Further, the second media processing task is set.

Method and apparatus for a step-enabled workflow

A method of managing capabilities of a media streaming network using at least one processor, including receiving a capability request for media streaming capabilities of an edge data network (EDN); determining the media streaming capabilities of the EDN; transmitting a capability response based on the determined media streaming capabilities; receiving a media processing workflow request based on the capability response; establishing a media streaming session according to the media processing workflow request; and streaming media content based on the media streaming session.

Methods for discovery of media capabilities of 5G edge

A method and apparatus for providing video content in a Dynamic Adaptive Streaming over Hypertext Transfer Protocol (DASH) streaming session may be provided. The method may include obtaining a pre-session-based description (PreSBD) information of the DASH streaming session instructing a PreSBD client to generate customized session-based description (SBD) document uniform resource locator (URL) for a plurality of SBD descriptors of the DASH streaming session. The method may further include instantiating the PreSBD client and passing PreSBD descriptor information. Then, the method may include controlling generation of a customized SBD document URL associated with a first SBD descriptor from the plurality of SBD descriptors of the DASH streaming session. The method may further include launching a first SBD client based on the customized SBD document URL and passing the first SBD descriptor.

Session-based description URL customization using the session-based dash operations

A method and apparatus may be provided for dynamically signaling picture-in-picture video during media streaming. The method may include determining whether video data comprises a first main video stream and a second picture-in-picture video stream based on a first role value associated with the first main video stream and a second role value associated with the second picture-in-picture video stream; determining a preselection descriptor indicating that the second picture-in-picture video stream is selected to be signaled with the first main video stream in the DASH media streaming; merging the first main video stream with the second picture-in-picture video stream as a combined video stream using the preselection descriptor; and updating the preselection descriptor using an update media presentation descriptor (MPD).

Method and apparatus for dynamic dash picture-in-picture streaming

A method is provided. The method includes generating, by a 5generation media streaming (5GMS) application provider, an edge configuration resource including at least one edge enabler client (EEC) capability specification, transmitting, by the 5GMS application provider, a request for provisioning an edge application server (EAS) to operate as a 5GMS application server (AS), the request including the edge configuration resource, and selecting, by the 5GMS application provider, the EAS to operate as the 5GMS AS based on the EAS being capable of performing the at least one EEC capability specification included in the edge configuration resource.

Growing community of inventors

Los Angeles, CA, United States of America

Iraj Sodagar