Mediatek Corporation

Jan Klopp

Tzu-Der Chuang

Ching-Yeh Chen

Yu-Wen Huang

Yu-Chi Su

Chih-Wei Hsu

Yu-Ling Hsiao

A method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to this method, the multiple frames in a video sequence comprises multiple segments, where each of the multiple segments comprises a set of frames. The NN (Neural Network) processing is applied to a target signal in one or more encoded frames of a target segment in the encoder side or to the target signal in one or more decoded frames of the target segment in the decoder side using one NN parameter set for the target segment. The target signal may correspond to reconstructed residual, reconstructed output, de-blocked output, SAO (sample adaptive offset) output, ALF (adaptive loop filter) output, or a combination thereof. In another embodiment, the NN processing is applied to a target signal only in one or more specific encoded or decoded frames.

Method and apparatus of neural network for video coding

Method and apparatus of video encoding video coding for a video encoder or decoder using Neural Network (NN) are disclosed. According to one method, input data or a video bitstream are received for blocks in one or more pictures, which comprise one or more colour components. The residual data, prediction data, reconstructed data, filtered-reconstructed data or a combination thereof is derived for one or more blocks of said one or more pictures. A target signal corresponding to one or more of the about signal types is processed using a NN (Neural Network) and the input of the NN or an output of the NN comprises two or more colour components. According to another method, A target signal corresponding to one or more of the about signal types is processed using a NN and the input of the NN or an output of the NN comprises two or more colour components.

Growing community of inventors

Hsinchu, Taiwan

Jan Klopp