Apple Inc.

Hfi Innovation Inc.

Mediatek Singapore Pte. Ltd.

Microsoft Technology Licensing, LLC

Mediatek Corporation

Mei Guo

Shaw-Min Lei

Hsi-Jung Wu

Jun Xin

Shan Liu

Xun Guo

Alexandros Michael Tourapis

Yeping Su

Chris Yoochang Chung

Xiaosong Zhou

Yunfei Zheng

Alican Nalci

Yeqing Wu

Shipeng Li

Feng Wu

Jun Xu

Xin Zhao

Yan Lu

Krishnakanth Rapaka

Jingteng Xue

Tzu-Der Chuang

Ching-Yeh Chen

Yu-Wen Huang

Dazhong Zhang

Chia-Yang Tsai

Albert E Keinath

Feng Yi

Yixin Du

Xingyu Zhang

Jean Begaint

Juliana Hsu

Guo Xun

Jiefu Zhai

An encoder or decoder can perform enhanced motion vector prediction by receiving an input block of data for encoding or decoding and accessing stored motion information for at least one other block of data. Based on the stored motion information, the encoder or decoder can generate a list of one or more motion vector predictor candidates for the input block in accordance with an adaptive list construction order. The encoder or decoder can predict a motion vector for the input block based on at least one of the one or more motion vector predictor candidates.

Enhanced motion vector prediction

Improved neural-network-based image and video coding techniques are presented, including hybrid techniques that include both tools of a host codec and neural-network-based tools. In these improved techniques, the host coding tools may include conventional video coding standards such H.266 (VVC). In an aspects, source frames may be partitioned and either host or neural-network-based tools may be selected per partition. Coding parameter decisions for a partition may be constrained based on the partitioning and coding tool selection. Rate control for host and neural network tools may be combined. Multi-stage processing of neural network output may use a checkerboard prediction pattern.

Hybrid neural network based end-to-end image and video coding method

A cross-component based filtering system is disclosed for video coders and decoders. The filtering system may include a filter having an input for a filter offset and an input for samples reconstructed from coded video data representing a native component of source video on which the filter operates. The offset may be generated at least in part from a sample classifier that classifies samples reconstructed from coded video data representing a color component of the source video orthogonal to the native component according to sample intensity.

Enhanced cross component sample offset filtering system for video coding and decoding

Techniques are disclosed for deriving prediction pixel blocks for use in intra-coding video and combined inter- and intra-coding video. In a first aspect, the techniques may include deriving value(s) for pixel location(s) of the prediction pixel block by, when a prediction direction vector assigned to the prediction vector points to quadrants I or III of a Cartesian plane, deriving the pixel location's value from pixel values in two regions of previously-decoded pixel data intercepted by extending the prediction direction vector in two opposite directions through the pixel location. When the prediction direction vector points toward quadrants II of the Cartesian plane, deriving the pixel location's value from pixel values in one region intercepted by the prediction direction vector through the pixel location, and from a second region intercepted by a vector that is orthogonal to the prediction direction vector.

Smoothed directional and DC intra prediction

Improved video coding techniques include deriving prediction pixel blocks for use in intra-coding video and combined inter- and intra-coding video. In a first aspect, the techniques may include deriving value(s) for pixel location(s) of the prediction pixel block by, when a prediction direction vector assigned to the prediction vector points to quadrants I or III of a Cartesian plane, deriving the pixel location's value from pixel values in two regions of previously-decoded pixel data intercepted by extending the prediction direction vector in two opposite directions through the pixel location. When the prediction direction vector points toward quadrants II of the Cartesian plane, deriving the pixel location's value from pixel values in one region intercepted by the prediction direction vector through the pixel location, and from a second region intercepted by a vector that is orthogonal to the prediction direction vector.

Techniques for video exchange are disclosed in which a video source sends redundant copies of video coded at a given presentation time. A decoder may determine, from metadata stored with a first decoded frame, whether other decoded frames have been designated as correlated to the first decoded frame. If so, the decoder may fetch other decoding frames using time indicator values of other decoded frames in metadata stored with the first decoded frame. When other decoded frame(s) are found, the decoder may blend content of the first coded frame and the other decoded frame(s). The decoder may render the blended frame. When one such coded frame is an intra-coded frame, the proposed technique may alleviate beating artifacts by blending recovered data of the intra-coded frame with recovered data of another frame, which may be inter-coded.

Temporally-overlapped video encoding, video decoding and video rendering techniques therefor

Techniques are disclosed for coding high dynamic range (HDR) data. According to such techniques, HDR data may be converted to a domain of uniform luminance data. The uniform domain data may be coded by motion compensated predictive coding. The HDR data also may be coded by motion compensated predictive coding, using a coding parameter that is derived from a counterpart coding parameter of the coding of the uniform domain data. In another technique, HDR data may be coded using coding parameters that are derived from HDR domain processing but distortion measurements may be performed in a uniform domain.

Video compression techniques for high dynamic range data

Systems and methods are disclosed for reshaping HDR video content to improve compression efficiency while using standard encoding/decoding techniques. Input HDR video frames, e.g., represented in an IPT color space, may be reshaped before the encoding/decoding process and the corresponding reconstructed HDR video frames may then be reverse reshaped. The disclosed reshaping methods may be combinations of scene-based or segment-based methods.

Luma and chroma reshaping of HDR video encoding

A method and apparatus for intra prediction for a current block using directional intra prediction based on neighboring pixels around the current block are disclosed. Embodiment according to the present invention derives the gradient for the current pixel from the neighboring reconstructed pixels along a prediction direction of directional intra prediction. The gradient derived is used to form the final intra prediction. In another embodiment of the present invention, the intra prediction for slant vertical and horizontal directions is derived based on the neighboring reconstructed pixels in a neighboring row adjacent to the top side of the current block and the neighboring reconstructed pixels in a neighboring column adjacent to the left side of the current block.

Method and apparatus of directional intra prediction

According to at least one aspect, a method for predictive Intra coding is provided. The method comprises: determining a set of Intra prediction modes used for prediction unit (PU) blocks with a plurality of different block sizes comprising a 4&#xd7;4 block size and at least two other block sizes; applying predictive Intra coding to a first PU block having a first block size that matches a block size in the plurality of different block sizes based on one or more neighboring PU blocks according to a first Intra prediction mode selected from the set of Intra prediction modes; and applying predictive Intra coding to a second PU block having a second block size that is different from the first block size and matches a block size in the plurality of different block sizes according to a second Intra prediction mode selected from the set of Intra prediction modes.

Method and apparatus for intra mode coding

The present disclosure describes techniques for coding video data in a manner that provides consistency to portions of the video that have similar content. According to such techniques, a video sequence may be parsed into partitions and content of the partitions may be analyzed. Partitions may be grouped together based on detected similarities in content. Coding parameters may be selected for each partition based on the partition's membership in the groups. Thus, when the video sequence is coded, coding parameters for frames of two commonly-grouped partitions may be similar, which causes coded video data to have similar presentation.

Scene based rate control for video compression and video streaming

Systems and methods are disclosed for coding pixel blocks of an input frame in which coding costs of a plurality of candidate coding modes are estimated. A coding cost of a candidate coding mode may be estimated based on noise estimate associated with the candidate coding mode. A coding mode for the input pixel block may be selected based on a comparison of the estimated coding costs of the plurality of candidate coding modes. The input pixel block may then be coded according to the selected coding mode.

Noise level control in video coding

The present disclosure describes a method of decoding a block, and the method includes receiving a flag indicating whether a current intra prediction mode is equal to any of one or more most probable modes, deriving, based on a value of the flag, the current intra prediction mode from a decoded mode index, and decoding the block according to the current intra prediction mode. The current intra prediction mode belongs to a mode set that includes a DC mode, a Planar mode, and at least one directional mode. The deriving the current intra prediction mode includes, when the mode index corresponds to a first mode index value representing the Planar mode, deriving the current intra prediction mode to be the Planar mode; and, when the mode index corresponds to a second mode index value representing the DC mode, deriving the current intra prediction mode to be the DC mode.

Growing community of inventors

San Jose, CA, United States of America

Mei Guo