Apple Inc.

Vid Scale, Inc.

Fanyi Duanmu

Hsi-Jung Wu

Xiaosong Zhou

Jun Xin

Yan Ye

Alexandros Michael Tourapis

Yuwen He

Xiaoyu Xiu

Christopher L Flick

Samir Gehani

John Y Su

Eduardo Asbun

Shalini Sahoo

A system obtains a data set representing immersive video content for display at a display time, including first data representing the content according to a first level of detail, and second data representing the content according to a second higher level of detail. During one or more first times prior to the display time, the system causes at least a portion of the first data to be stored in a buffer. During one or more second times prior to the display time, the system generates a prediction of a viewport for displaying the content to a user at the display time, identifies a portion of the second data corresponding to the prediction of the viewport, and causes the identified portion of the second data to be stored in the video buffer. At the display time, the system causes the content to be displayed to the user using the video buffer.

Immersive video streaming using view-adaptive prefetching and buffer control

A block may be identified. The block may be partitioned into one or more (e.g., two) sibling nodes (e.g., sibling nodes BO and B). A partition direction and a partition type for the block may be determined. If the partition type for the block is binary tree (BT), one or more (e.g., two) partition parameters may be determined for sibling node BO. A partition parameter (e.g., a first partition parameter) may be determined for sibling node B. A decoder may determine whether to receive an indication of a second partition parameter for Bbased on, for example, the partition direction for the block, the partition type for the block, and the first partition parameter for B. The decoder may derive the second partition parameter based on, for example, the partition direction and type for the block, and the first partition parameter for B

Multi-type tree coding

Techniques for multi-view video streaming are described in the present disclosure, wherein a viewport prediction may be employed at a client-end based on analysis of pre-fetched media item data and ancillary information. A streaming method may first prefetch a portion of content of a multi-view media item. The method may next identify a salient region from the prefetched content and may then download additional content of the media item that corresponds to the identified salient region.

Client-end enhanced view prediction for multi-view video streaming exploiting pre-fetched data and side information

Techniques are disclosed for coding and delivering multi-view video in which the video is represented as a manifest file identifying a plurality of segments of the video available for download. The multi-view video may be partitioned spatially into a plurality of tiles that, in aggregate, encompass the entire spatial area of the video. The tiles are coded as segments contains coded video representing content contained within its respective tile. Tiles may be given different sizes based on saliency of the content within their respective regions. In this manner, tiles with high levels of interest may have relatively large spatial areas, which can lead to efficient coding in the presence of content motion.

Versatile tile coding for multi-view video streaming

Growing community of inventors

Cupertino, CA, United States of America

Fanyi Duanmu