Huawei Technologies Co., Limited

Zhejiang University

Yuqun Fan

Ye-Kui Wang

Huameng Fang

Peiyun Di

Jianle Chen

Haitao Yang

Yin Zhao

Lei Zhou

Lu Yu

Hualong Yu

Fuzheng Yang

Huanbang Chen

Lian Zhang

Xiang Ma

Weihua Qiao

Xiaoding Gao

Xin Wang

Xiangyu Lin

A method mechanism for streaming multi-viewpoint virtual reality (VR) content via Dynamic Adaptive Streaming over Hypertext Transfer Protocol (HTTP) (DASH) is disclosed. The mechanism includes receiving media content including a VR video sequence. A DASH Media Presentation Description (MPD) is generated. The MPD includes an indication specifying that a portion of the media content that is related to a first viewpoint is associated with a timed metadata representation. A request is received from a client for the media content. The DASH MPD, including the indication, is transmitted to the client in response to receiving the request to support communication of the media content to the client.

Efficient association between DASH objects

A client, a server, and a method for processing media data, the method including obtaining an overlay and information about a region associated with the overlay, where the information about the region associated with the overlay is used to indicate the region associated with the overlay, and displaying the overlay when a trigger operation for the region associated with the overlay is detected.

Method for processing media data, client, and server

A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes mapping a spherical video sequence into a plurality of sub-picture video sequences. The mechanism further includes encoding the plurality of sub-picture video sequences as sub-picture bitstreams to support merging of the plurality of sub-picture bitstreams, the encoding ensuring that each sub-picture bitstream is self-referenced and two or more of the sub-picture bitstreams can be merged to generate a single video bitstream using a lightweight bitstream rewriting process that does not involve changing of any block-level coding results. A mergeable indication is encoded to indicate that the sub-picture bitstream containing the indication is compatible with a multi-bitstream merge function for reconstruction of the spherical video sequence. A set of the sub-picture bitstreams and the mergeable indication are transmitted toward the decoder to support decoding and displaying a virtual reality video viewport.

Bitstream signaling of error mitigation in sub-picture bitstream based viewport dependent video coding

A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes mapping a spherical video signal, stitched from multiple directional video signals, into a plurality of sub-picture video signals each containing a sequence of sub-pictures. The plurality of sub-picture video signals are encoded as a plurality of sub-picture bitstreams. The plurality of sub-picture bitstreams are composed into a plurality of sub-picture tracks to be compatible with a multi-bitstream merge function for reconstruction of the spherical video signal. A track level mergable indication is encoded within a track level box for the sub-picture tracks, which indicates the sub-picture tracks are compatible with the multi-bitstream merge function for reconstruction of the spherical video signal.

File format signaling of error mitigation in sub-picture bitstream based viewport dependent video coding

A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes receiving a spherical video signal stitched from multiple directional video streams. The spherical video signal is mapped into a plurality of sub-picture video signals each containing a sequence of sub-pictures. The plurality of sub-picture video signals, are encoded as a plurality of sub-picture bitstreams, such that, when decoded at a decoder, a value of each sample in each sub-picture is identical to a value of a corresponding sample in a decoded entire picture composed from the sub-pictures. The plurality of sub-picture bitstreams are composed into a plurality of sub-picture tracks with an indication that the sub-picture tracks are conforming to a particular video profile. The sub-picture bitstreams are transmitted toward a decoder to support decoding and displaying virtual reality video viewport.

Error mitigation in sub-picture bitstream based viewpoint dependent video coding

A method comprises obtaining media content associated with a first viewpoint and a second viewpoint, wherein a first position of the first viewpoint is static and a second position of the second viewpoint is dynamic; generating a first VWPT descriptor based on the media content and describing the first viewpoint; generating a second VWPT descriptor based on the media content and describing the second viewpoint; generating an MPD comprising the first VWPT descriptor and the second VWPT descriptor; and transmitting the MPD.

Associating file format objects and dynamic adaptive streaming over hypertext transfer protocol (DASH) objects

This application discloses a picture display order determining method which includes: obtaining a decoding order index value of a current picture and a decoding order index value of a previous picture that is adjacent to the current picture according to a decoding order; adding 1 to a cycle identifier value when the decoding order index value of the current picture is less than the decoding order index value of the previous picture; and determining a display order index value of the current picture based on a sum of the decoding order index value of the current picture and a preset positive integer multiple of the cycle identifier value. In this application, the display order index value of the current picture progressively increases based on a display order index value of a picture that is located before the current picture according to the decoding order.

Picture display order determining method and apparatus, and video coding device

A video encoding method, a video decoding method, an apparatus, a device, and a storage medium include parsing a first flag from the video bitstream when a video bitstream is allowed to be decoded by referencing a library picture corresponding to a library picture bitstream, using a value of a target parameter of the video bitstream as a value of a target parameter of the library picture bitstream referenced by the video bitstream when a value of the first flag is a first value, and reconstructing, based on the value of the target parameter of the library picture bitstream referenced by the video bitstream and the library picture bitstream referenced by the video bitstream to obtain the library picture corresponding to the library picture bitstream referenced by the video bitstream.

Video coding and decoding methods and devices using a library picture bitstream

This application provides a media data processing method and apparatus. A media processing device receives a media stream. The media stream includes media data recorded at a plurality of viewpoints. The device obtains metadata information of the media stream. The metadata information includes viewpoint identification information of the viewpoints. The device displays media data of a first viewpoint based on the viewpoint identification information. The device also displays indications of other viewpoints when displaying the media data of the first viewpoint, so that a user of the device can switch to display media data of other viewpoints.

Media data processing method and apparatus

A video coding mechanism for viewpoint dependent video coding is disclosed. The mechanism includes mapping a spherical video sequence into a plurality of sub-picture video sequences. The mechanism further includes encoding the plurality of sub-picture video sequences as sub-picture bitstreams to support merging of the plurality of sub-picture bitstreams, the encoding ensuring that each sub-picture bitstream is self-referenced and two or more of the sub-picture bitstreams can be merged to generate a single video bitstream using a lightweight bitstream rewriting process that does not involve changing of any block-level coding results. A mergable indication is encoded to indicate that the sub-picture bitstream containing the indication is compatible with a multi-bitstream merge function for reconstruction of the spherical video sequence. A set of the sub-picture bitstreams and the mergable indication are transmitted toward the decoder to support decoding and displaying a virtual reality video viewport.

A decoding method includes obtaining an identifier from a bitstream, where the identifier indicates a minimum decoding time interval k between library pictures that is allowed in the bitstream, obtaining, when parsing the bitstream, a decoding moment tof a current decoded picture and a decoding moment tof a first decoded picture that is closest to the current decoded picture and that references a new library picture when the current decoded picture is decoded by referencing a library picture, where the new library picture is a library picture that is not decoded or needs to be re-decoded when the first decoded picture is decoded, and determining a preset quantity of library pictures as candidate reference pictures of the current decoded picture based on a relationship between k and a difference between tand t.

Video encoder, video decoder, and corresponding method of predicting random access pictures

A media information processing method includes obtaining media description information, where the media description information includes description information of at least two bitstreams corresponding to a first picture area, any one of the at least two bitstreams has an access point different in time from an access point of another bitstream in the at least two bitstreams, the at least two bitstreams are bitstreams obtained by separately encoding picture content of the first picture subarea, and time periods corresponding to the picture content separately encoded by the at least two bitstreams overlap, and determining, based on the media description information, a to-be-played first target bitstream, where the first target bitstream is one of the at least two bitstreams.

Media information processing method, related device, and computer storage medium

This application provides a media data transmission method and apparatus. The method includes: receiving, by a client, a media presentation description (MPD) file, where the MPD file includes priority indication information, and the priority indication information is used to indicate a priority or priorities of one or more overlays; and processing, by the client, the one or more overlays based on the priority indication information.

Media data transmission method, client, and server

Error mitigation in sub-picture bitstream based viewport dependent video coding

A media data transmission method and an apparatus. The method includes: A client sends first information to a server. The client receives video data packets that correspond to a second target video picture and that are sent by the server. The first information is used to indicate spatial information of a region in which a first target video picture is located, and the first target video picture includes a video picture within a current viewport. The second target video picture includes the first target video picture, at least one of the video data packets corresponding to the second target video picture carries at least one piece of second information, and the second information is used to indicate spatial information of a region in which the second target video picture is located.

Growing community of inventors

Shenzhen, China

Yuqun Fan