Qualcomm Incorporated

Apple Inc.

Beijing Dajia Internet Information Technology Co., Ltd.

Guoxin Jin

Marta Karczewicz

Xin Zhao

Jianle Chen

Xianglin Wang

Alexandros Michael Tourapis

Hsi-Jung Wu

Shuiming Ye

Yeqing Wu

Shufei Fan

Wei-Jung Chien

Xiang Li

Yunfei Zheng

Bing Yu

Jun Xin

Hilmi Enes Egilmez

Yixin Du

Yi-Wen Chen

Pang Chao

Techniques are proposed to improve temporal motion projection in video coding. Candidate reference frames available for use in temporal motion projection are sorted in processing order according to scores assigned based on estimates of the reference frames' suitability for prediction. Such estimates may be based on temporal distance between each candidate reference frame and that reference frame's prediction references. Estimates may be based, for each reference frame, based on an estimate of coding quality of a reference frame from which the respective candidate reference frame makes a prediction reference. Once sorted, the candidate reference frames may be processing in the sorting order to supply prediction data to a current frame that is to be coded from the candidate reference frames. Additionally, hardware friendly designs of motion field hole filling and motion vector smoothing operations are proposed. Such designs can reduce hardware implementation complexity and benefit hardware parallel processing in several aspects: by removing the dependency among different processing block rows for hole filling and motion vector smoothing so that it is becomes easier and friendlier to achieve hardware parallel processing; by reducing the hardware bandwidth loading overhead; by improving hardware pipeline throughput; and/or by avoiding adding a line buffer to store the data from the above row since a line buffer will increase hardware cost.

Hardware friendly design for motion field processing and quality improvement of motion field

Embodiments of the disclosure provide systems and methods for performing occlusion detection in frame rate up-conversion of video data including a sequence of image frames. The method includes determining, by a video processor, whether a target block of a target frame is a potential occlusion block based on at least one of motion vector information or distortion metric information associated with the target block. The target frame is to be generated and interpolated into the sequence of image frames. Responsive to the target block being the potential occlusion block, the method further includes detecting, by the video processor, an occlusion type of the target block. The method additionally includes generating, by the video processor, the target block by performing a motion compensation method adaptively selected based on the occlusion type of the target block.

System and method for occlusion detection in frame rate up-conversion of video data

Video coders and decoders perform transform coding and decoding on blocks of video content according to an adaptively selected transform type. The transform types are organized into a hierarchy of transform sets where each transform set includes a respective number of transforms and each higher-level transform set includes the transforms of each lower-level transform set within the hierarchy. The video coders and video decoders may exchange signaling that establishes a transform set context from which a transform set that was selected for coding given block(s) may be identified. The video coders and video decoders may exchange signaling that establishes a transform decoding context from which a transform that was selected from the identified transform set to be used for decoding the transform unit. The block(s) may be coded and decoded by the selected transform.

Incremental transform set construction and transform signaling for video coding

Embodiments of the disclosure provide systems and methods for performing frame rate up-conversion of video data including a sequence of image frames. The method may include determining a set of motion vectors of a target frame relative to a plurality of reference frames. The target frame is to be generated and interpolated into the sequence of image frames. The method may further include performing a motion vector classification on the set of motion vectors to generate a target object map for the target frame. The method may additionally include projecting the target object map onto the plurality of reference frames to generate a plurality of reference object maps based on the set of motion vectors. The method may additionally include detecting an occlusion area in the target frame based on the set of motion vectors, the target object map, and the plurality of reference object maps.

System and method for frame rate up-conversion of video data

Systems, methods, and computer-readable media are described for providing improved video or image encoding, including adaptive prediction structures for encoding video frames. In some examples, systems, methods, and computer-readable media can include obtaining a sequence of frames; determining, based on frame statistics associated with a first frame in the sequence of frames, a prediction structure for encoding the sequence of frames, the prediction structure defining an order in which frames in the sequence of frames are encoded and a prediction distance representing a maximum distance permitted between referencing frames and reference frames in the sequence of frames, and the frame statistics indicating an amount of motion in the first frame. The systems, methods, and computer-readable media can also include encoding one or more of the sequence of frames based on the prediction structure.

Adaptive prediction structures

Techniques are described in which a video decoder is configured to partition, into a plurality of sub-blocks, a block of a picture of the video data. The video decoder is further configured to, for each respective sub-block of the plurality of sub-blocks, derive a respective first motion vector of the respective sub-block based on motion information for at least two blocks neighboring the respective sub-block. The video decoder also determines, based on a respective motion vector difference for the respective sub-block signaled in a bitstream, a second motion vector for the respective sub-block. Additionally, the video decoder generates, based on the first motion vector of the respective sub-block and the second motion vector of the respective sub-block, a predictive block for the respective sub-block.

Sub-PU based bi-directional motion compensation in video coding

Growing community of inventors

San Diego, CA, United States of America

Guoxin Jin