At&t Intellectual Property I, L.p.

University of Minnesota

Indiana University

The Hong Kong University of Science and Technology

Hewlett-packard Development Company, L.p.

Bo Han

Vijay Gopalakrishnan

Lusheng Ji

Feng Qian

Zhengye Liu

Jackson Jarrell Pair

Cheuk Yiu Ip

Tan Xu

Shuai Hao

Zhi-Li Zhang

Yang Zhang

Robert Raymond Miller, Ii

Rittwik Jana

Jin Wang

Muhammad Bilal Anwer

Eric Martin Zavesky

Xidong Wu

Manuel Briand

Sassan Pejhan

Vikash Sharma

Shu Shi

Matteo Varvello

Pan Hui

Wenxiao Zhang

Huanle Zhang

Chenfei Gao

Bo Chen

Zihui Ge

Aman M Shaikh

Moo-Ryong Ra

Marco Platania

Joshua Reich

David Crawford Gibbon

John F Murray

Seungjoon Lee

Peshala Vishvajith Pahalawatta

Sung-Ju Lee

Jung Gun Lee

Robert Miller

Donglin Hu

Samrat Bhattacharjee

Bo Yan

Qingyang Xiao

Aspects of the subject disclosure may include, for example, a device that has a processing system including a processor; and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, including downsampling a full point cloud to obtain a downsampled point cloud, wherein the downsampling reduces a data size of the full point cloud; and using a machine-learning model to assign labels for segmentation and object identification to points in the downsampled point cloud, wherein the machine-learning model is trained on the full point cloud. Other embodiments are disclosed.

Method for accelerating three-dimensional object segmentation with point cloud simplifications

Aspects of the subject disclosure may include, for example, obtaining one or more signals, the one or more signals being based upon brain activity of a viewer while the viewer is viewing media content; predicting, based upon the one or more signals, a first predicted desired viewport of the viewer; obtaining head movement data associated with the media content; predicting, based upon the head movement data, a second predicted desired viewport of the viewer; comparing the first predicted desired viewport to the second predicted desired viewport, resulting in a comparison; and determining, based upon the comparison, to use the first predicted desired viewport to facilitate obtaining a first subsequent portion of the media content or to use the second predicted desired viewport to facilitate obtaining a second subsequent portion of the media content. Other embodiments are disclosed.

Facilitating panoramic video streaming with brain-computer interactions

The described technology is generally directed towards a transport protocol for latency sensitive applications. The disclosed transport protocol is 'semi-reliable' in that it allows for specification of an importance of data being transmitted, thereby allowing important data to be sent reliably, while other data can be dropped if necessary, e.g., under bad network conditions. A deadline can be specified for such other data, and if the other data cannot be sent prior to the deadline, it can be dropped. Furthermore, the disclosed transport protocol can allow for early discovery of network jitter. A client device can send regular acknowledgments which identify most recently received data packets as well as a number of “heartbeat transmissions” received at the client device. A server device can use the acknowledgments to discover and respond to jitter.

Transport protocol for latency sensitive applications

A network processing system obtains a viewport of a client device for volumetric video and a two-dimensional (2D) subframe of a frame of volumetric video is obtained associated with the viewport. Viewports may be obtained from the client device or be predicted. 2D subframes and reduced resolution versions of frames can be transmitted to the client device. A client device may request volumetric video from the network processing system and provides a viewport to the network processing system. The client device may obtain from the network processing system reduced resolution versions of volumetric video frames and 2D subframes in accordance with the viewport. The client device may determine whether a current viewport matches the viewport associated with the obtained 2D subframe and provides a display based on either that subframe (upon a match) or a 2D perspective of the reduced resolution frame associated with the current viewport (if no match).

Processing system for streaming volumetric video to a client device

Aspects of the subject disclosure may include, for example, a method for spherical video streaming over a network by a processing system including a processor, the method including prefetching audio data for rendering the spherical video; determining whether there is a single source or a plurality of sources of audio in the audio data; responsive to a determination that there is only one dominant source of the audio in the audio data, prefetching video data in a field of view centered on spatial coordinates of the dominant source of audio; responsive to a determination that there is the plurality of sources of the audio in the audio data, sorting the plurality of sources of the audio according to an estimated sound source energy for each source in the plurality of sources, thereby creating a sorted list of the plurality of sources; and prefetching video data in plural fields of view centered on spatial coordinates of each audio source in the sorted list of the plurality of sources, wherein the prefetching is performed in an order corresponding to the sorted list, and wherein the prefetching occurs within an available bandwidth of the network. Other embodiments are disclosed.

Method of audio-assisted field of view prediction for spherical video streaming

Systems and methods are disclosed for parallelizing service function chains. A method comprises receiving a sequential service function chain comprising a plurality of network functions, receiving a plurality of operations, determining at least two network functions are capable of being parallelized, aggregating operations of the plurality of operations associated with the at least two network functions into a network function segment, determining whether another network function is capable of being parallelized with the network function segment, based on the determining: aggregating an operation associated with the another network function into the network function segment when the another network function is capable of being parallelized with the network function segment, or pushing the network function segment as a completed segment of a hybrid service function chain when the another network function is not capable of being parallelized with the network function segment, and implementing the hybrid service function chain.

Controlling parallel data processing for service function chains

Systems, computer-readable media, and methods are disclosed for parallel data processing for service function chains with network functions spanning multiple servers. An example system includes a first server hosting a first network function of a service function chain, a second server hosting a second network function of the service function chain, a mirror function deployed in a first switch to replicate a plurality of packets received by the system and to send respective copies of the plurality of packets to the first network function and to at least one of the second network function and a third network function of the service function chain, and a merge function deployed in a second switch to merge respective outputs of the first network function and the at least one of the second network function and the third network function.

Parallel data processing for service function chains spanning multiple servers

Aspects of the subject disclosure may include, for example, transmitting viewpoint information associated with a first portion of a three-dimensional (3D)/volumetric video to a device, wherein the viewpoint information comprises a first coordinate in 3D space associated with a first viewing direction in a playback of the first portion and a first timestamp associated with the first portion, receiving, from the device, a multiplane image (MPI) representation of a second portion of the 3D video responsive to the transmitting of the viewpoint information, and providing an image of the MPI representation to a display device. Other embodiments are disclosed.

Apparatus and method for providing content with multiplane image transcoding includes user history of confidence

Aspects of the subject disclosure may include, for example, a device, that includes a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations including receiving a manifest for a point cloud, wherein the point cloud is partitioned into a plurality of cells; determining an occlusion level for a cell of the plurality of cells with respect to a predicted viewport; reducing a point density for the cell provided in the manifest based on the occlusion level, thereby determining a reduced point density; and requesting delivery of points in the cell, based on the reduced point density. Other embodiments are disclosed.

Method of determining occlusion based visibility for volumetric video streaming

Aspects of the subject disclosure may include, for example, embodiments for selecting a first camera from one or more cameras communicatively coupled to a computing device. Further embodiments include adjusting a first hardware controller on the first camera in response to detecting a network condition of a communication network resulting in an adjusted first camera. Additional embodiments include capturing first video content with the adjusted first camera. Also, embodiments include transmitting the first video content to a video content server over the communication network. Other embodiments are disclosed.

Methods, systems and devices for adjusting panoramic view of a camera for capturing video content

The described technology is generally directed towards a transport protocol for latency sensitive applications. The disclosed transport protocol is 'semi-reliable' in that it allows for specification of an importance of data being transmitted, thereby allowing important data to be sent reliably, while other data can be dropped if necessary, e.g., under bad network conditions. A deadline can be specified for such other data, and if the other data cannot be sent prior to the deadline, it can be dropped. Furthermore, the disclosed transport protocol can allow for early discovery of network jitter. A client device can send regular acknowledgments which identify most recently received data packets as well as a number of 'heartbeat transmissions' received at the client device. A server device can use the acknowledgments to discover and respond to jitter.

Aspects of the subject disclosure may include, for example, a method including providing a video presentation to user devices. A latency related to the video presentation is determined for each device; a high-latency user device is identified having greater latency than other, low-latency devices. Field of view information is analyzed for each of the low-latency devices; based on the analyzing, a field of view of the high-latency user device is predicted. In accordance with the predicting, a predicted viewing map for the high-latency user device is generated. The video presentation for the high-latency user device is adjusted based on the predicted viewing map. Other embodiments are disclosed.

Field of view prediction in live panoramic video streaming

Aspects of the subject disclosure may include, for example, embodiments for obtaining video content from a video content server, determining a quality parameter for each of the plurality of adjusted video content, and adjusting the video content to generate the plurality of adjusted video content. Each of the plurality of adjusted video content comprises a different point cloud density according to the quality parameter. Further embodiments can include receiving a request for the video content from a video content application on a communication device, and determining a distance from a viewpoint to a point-cloud object on the video content application of the communication device. Additional embodiments can include selecting an adjusted video content based on the distance from the viewpoint to the point-cloud object and the quality parameter of the adjusted video content, and providing the adjusted video content to the communication device for presentation. Other embodiments are disclosed.

Method, systems and devices for providing adjusted video content according to viewing distance

Aspects of the subject disclosure may include, for example, obtaining live video content from equipment of a media content provider, determining priority content within the live video content; segmenting the live video content into a plurality of tiles according to the priority content, and transcoding the live video content according to a type of client device. Further embodiments include determining an encoding schedule for the plurality of tiles according to the priority content, encoding the plurality of tiles according to the encoding schedule, and providing the plurality of tiles to the client device. Other embodiments are disclosed.

Methods, devices, and systems for encoding portions of video content according to priority content within live video content

Growing community of inventors

Bridgewater, NJ, United States of America

Bo Han