Electronics and Telecommunications Research Institute

Lg Household & Health Care Ltd.

Korea Research Institute of Standards and Science

Osong Medical Innovation Foundation, Korea University Research and Business Foundation

Lg Chemical Ltd.

Industrial Cooperation Foundation Chonbuk National University

Jong-Ho Kim

Se-Yoon Jeong

Jin-Soo Choi

Joo-Young Lee

Youn-Hee Kim

Hui-Yong Kim

Ji-Young Kim

Sug-Youn Chang

Sei-Young Yun

Seung-Hyun Cho

Woong Lim

Jin-Wuk Seok

Dae-Yeol Lee

Tae-Jin Lee

Dong-Hyun Kim

Hyoung-Jin Kwon

Ji-Hoon Do

Min-Seok Kim

Hyunsuk Ko

Jong-Yoon Shin

Ji-Wook Youn

Yon-Kyu Park

Je-Won Kang

Dae-im Kang

Na-Young Kim

Jae-Hyuk Choi

Hae-Young Yang

Sang-Hoon Kwak

Hyun-joon Kwon

Yong-Seok Choi

Sung-Chang Lim

Chang-Joo Kim

Seoung-Jun Oh

Dong-Gyu Sim

Seung-Kwon Beack

Yun-gu Lee

Seung-won Jung

Kwang Soon Ha

Moon-jeong Rang

Dong-Wook Kim

Heon-Jin Hong

Je-soo Ko

Min-Hun Lee

Jee-Hoon Kim

Kwang-Hwan Kim

Han-Sol Choi

Ho-Kyung Son

Moon-Ho Lee

Jia Hou

Kwang-Jae Lee

Jongyoon Shin

Young-Keun Yoon

An-gi Choi

Jung-Kyung Lee

Ki-Hwan Ko

Chang-Hyun Jang

Shanglin Yang

Seon-Ho Shin

C-c Jay Kuo

Kyu-Yeol Choi

Qin Huang

Disclosed herein are a method, an apparatus, and a storage medium for image encoding/decoding using filtering. The image encoding method and the image decoding method perform classification on a classification unit of a target image, and perform filtering that uses a filter on the classification unit. A classification index of the classification unit is determined, and the classification index indicates a filter to be used for filtering on the classification unit, among multiple filters. The classification index is determined by various coding parameters, such as an encoding mode of the target block and an encoding mode of a neighboring block adjacent to the target block.

Method, apparatus and storage medium for image encoding/decoding using filtering

An encoding apparatus extracts features of an image by applying multiple padding operations and multiple downscaling operations to an image represented by data and transmits feature information indicating the features to a decoding apparatus. The multiple padding operations and the multiple downscaling operations are applied to the image in an order in which one padding operation is applied and thereafter one downscaling operation corresponding to the padding operation is applied. A decoding method receives feature information from an encoding apparatus, and generates a reconstructed image by applying multiple upscaling operations and multiple trimming operations to an image represented by the feature information. The multiple upscaling operations and the multiple trimming operations are applied to the image in an order in which one upscaling operation is applied and thereafter one trimming operation corresponding to the upscaling operation is applied.

Method, apparatus, and storage medium using padding/trimming in compression neural network

Disclosed herein are a method, an apparatus, and a storage medium for image encoding/decoding. An intra-prediction mode for the target block is derived, and intra-prediction for the target block that uses the derived intra-prediction mode is performed. The intra-prediction mode for the target block is derived using an artificial neural network, and an MPM list for the target block is derived using information about the target block, pieces of information about blocks adjacent to the target block, and the artificial neural network. The artificial neural network outputs one or more available intra-prediction modes. Further, the artificial neural network outputs match probabilities for one or more candidate intra-prediction modes, and each of the match probabilities for the candidate intra-prediction modes indicates a probability that the corresponding candidate intra-prediction mode matches the intra-prediction mode for the target block.

Apparatus, method and storage medium for image encoding/decoding to perform intra prediction using artificial neutral network

Disclosed herein are a method, an apparatus and a storage medium for image encoding/decoding using a binary mask. An encoding method includes generating a latent vector using an input image, generating a selected latent vector component set using a binary mask, and generating a main bitstream by performing entropy encoding on the selected latent vector component set. A decoding method includes generating a selected latent vector component set including one or more selected latent vector components by performing entropy decoding on a main bitstream and generating the latent vector in which the one or more selected latent vector components are relocated by relocating the selected latent vector component set in the latent vector.

Method, apparatus and storage medium for image encoding/decoding using binary mask

Disclosed herein are a method and apparatus for compressing learning parameters for training of a deep-learning model and transmitting the compressed parameters in a distributed processing environment. Multiple electronic devices in the distributed processing system perform training of a neural network. By performing training, parameters are updated. The electronic device may share the updated parameter thereof with additional electronic devices. In order to efficiently share the parameter, the residual of the parameter is provided to the additional electronic devices. When the residual of the parameter is provided, the additional electronic devices update the parameter using the residual of the parameter.

Method and device for providing compression and transmission of training parameters in distributed processing environment

Disclosed herein are a method, apparatus, system, and computer-readable recording medium for image compression. An encoding apparatus performs preprocessing of feature map information, frame packing, frame classification, and encoding. A decoding apparatus performs decoding, frame depacking, and postprocessing in order to reconstruct feature map information. By encoding the feature map information, inter-prediction and intra-block prediction for a frame are performed. The encoding apparatus provides the decoding apparatus with a feature map information bitstream for reconstructing the feature map information along with an image information bitstream.

Method, apparatus, system and computer-readable recording medium for feature map information

A method and apparatus for image compression using a latent variable are provided. The multiple components of the latent variable may be sorted in order of importance. Through sorting, when the feature information of only some of the multiple components is used, the quality of a reconstructed image may be improved. In order to generate a latent variable, the components of which are sorted in order of importance, learning may be performed in various manners. Also, less important information may be eliminated from the latent variable, and processing, such as quantization, may be applied to the latent variable. Through elimination and processing, the amount of data for the latent variable may be reduced.

Method and device for compressing image and neural network using hidden variable

Disclosed herein is a context-adaptive entropy model for end-to-end optimized image compression. The entropy model exploits two types of contexts. The two types of contexts are a bit-consuming context and a bit-free context, respectively, and these contexts are classified depending on the corresponding context requires the allocation of additional bits. Based on these contexts, the entropy model may more accurately estimate the distribution of each latent representation using a more generalized form of entropy models, thus improving compression performance.

Method and apparatus for image processing using context-adaptive entropy model

Disclosed herein are a method and apparatus for measuring video quality based on a perceptually sensitive region. The quality of video may be measured based on a perceptually sensitive region and a change in the perceptually sensitive region. The perceptually sensitive region includes a spatial perceptually sensitive region, a temporal perceptually sensitive region, and a spatio-temporal perceptually sensitive region. Perceptual weights are applied to a detected perceptually sensitive region and a change in the detected perceptually sensitive region. Distortion is calculated based on the perceptually sensitive region and the change in the perceptually sensitive region, and a result of quality measurement for a video is generated based on the calculated distortion.

Method and apparatus for measuring video quality based on detection of change in perceptually sensitive region

Disclosed herein are a method and apparatus for video decoding and a method and apparatus for video encoding. A prediction block for a target block is generated by predicting the target block using a prediction network, and a reconstructed block for the target block is generated based on the prediction block and a reconstructed residual block. The prediction network includes an intra-prediction network and an inter-prediction network and uses a spatial reference block and/or a temporal reference block when it performs prediction. For learning in the prediction network, a loss function is defined, and learning in the prediction network is performed based on the loss function.

Image encoding and decoding method and device using prediction network

An inter-prediction method and apparatus uses a reference frame generated based on deep learning. In the inter-prediction method and apparatus, a reference frame is selected, and a virtual reference frame is generated based on the selected reference frame. A reference picture list is configured to include the generated virtual reference frame, and inter prediction for a target block is performed based on the virtual reference frame. The virtual reference frame may be generated based on a deep-learning network architecture, and may be generated based on video interpolation and/or video extrapolation that use the selected reference frame.

Inter-prediction method and apparatus using reference frame generated based on deep learning

Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus. A virtual frame is generated by a video generation network including a generation encoder and a generation decoder. The virtual frame is used as a reference frame in inter prediction for a target. Further, a video generation network for inter prediction may be selected from among multiple video generation networks, and inter prediction that uses the selected video generation network may be performed.

Method and apparatus for video encoding and video decoding based on neural network

Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus. In quantization and dequantization, multiple quantization methods and multiple dequantization methods may be used. The multiple quantization methods include a variable-rate step quantization method and a fixed-rate step quantization method. The variable-rate step quantization method may be a quantization method in which an increment in a quantization step depending on an increase in a value of a quantization parameter by 1 is not fixed. The fixed-rate step quantization method may be a quantization method in which the increment in the quantization step depending on the increase of the value of the quantization parameter by 1 is fixed.

Method and apparatus for quantization

Disclosed herein are a method and apparatus that adaptively perform encoding and decoding based on image quality. An encoding apparatus may determine optimal Frames Per Second (FPS) for a video and may encode the video based on the determined FPS. Further, the encoding apparatus may provide improved temporal scalability. A decoding apparatus may select a frame to be displayed from among frames of a video depending on a required minimum satisfied user ratio. Through the selection of the frame, the decoding apparatus may provide improved temporal scalability.

Method and apparatus for adaptive encoding and decoding based on image quality

Growing community of inventors

Daejeon, South Korea

Jong-Ho Kim