Samsung Electronics Co., Ltd.

Jaeyeon Park

Tammy Lee

Iljun Ahn

Yongsup Park

Minsu Cheon

Kwangpyo Choi

Hanul Shin

Donghyun Kim

Youngsu Moon

Hyunseung Lee

Cheon An Lee

Taegyoung Ahn

Jaehee Kwak

Soomin Kang

Sangwook Baek

Youngchan Song

Quockhanh Dinh

Changhan Kim

Cheon Lee

Heeseok Oh

Kiheum Cho

IIjun Ahn

Provided are an image processing apparatus and an operation method of the image processing apparatus. The image processing apparatus includes a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to, by using one or more convolution neural networks, extract target features by performing a convolution operation between features of target regions having same locations in a plurality of input images and a first kernel set, extract peripheral features by performing a convolution operation of features of peripheral regions located around the target regions in the plurality of input images and a second kernel set, and determine a feature of a region corresponding to the target regions in an output image, based on the target features and the peripheral features.

Image processing device for improving details of an image, and operation method of the same

An image processing apparatus, including a memory configured to store one or more instructions; and a processor configured to execute the one or more instructions stored in the memory to obtain similarity information indicating a similarity between each pixel of a plurality of pixels included in a first image and an adjacent pixel of the each pixel; generate a weight map including weight information corresponding to the each pixel, based on the similarity information; generate a spatially variant kernel including a plurality of kernels corresponding to the plurality of pixels, based on the weight map and a spatial kernel including weight information based on a location relationship between the each pixel and the adjacent pixel; and generate a second image by applying the spatially variant kernel to the first image.

Image processing apparatus and operation method thereof

An image processing apparatus, including a processor configured to execute instructions stored in a memory to: obtain characteristic information of a first image, divide the characteristic information into a plurality of groups, input each group into a respective layer of a plurality of layers included in a convolutional neural network and perform a convolution operation using one or more kernels to obtain a plurality of pieces of output information, generate an attention map including weight information corresponding to each pixel included in the first image, based on the plurality of pieces of output information, generate a spatially variant kernel including a kernel corresponding to the each pixel, based on the attention map and a spatial kernel including weight information according to a position relationship between the each pixel and a neighboring pixel, and generate a second image by applying the spatially variant kernel to the first image.

Image processing apparatus and operating method thereof

An image processing apparatus, including a memory configured to store one or more instructions; and at least one processor configured to execute the one or more instructions to: based on a first image and a probability model, optimize an estimated pixel value and estimated gradient values of each pixel of an original image corresponding to the first image, obtain an estimated original image based on the optimized estimated pixel value of the each pixel of the original image, obtain a decontour map based on the optimized estimated pixel value and the estimated gradient values of the each pixel of the original image, and generate a second image by combining the first image with the estimated original image based on the decontour map.

Provided is an image processing apparatus including a memory storing one or more instructions and a processor configured to execute the one or more instructions stored in the memory, wherein the processor is further configured to execute the one or more instructions to generate a second image by performing a deconvolution operation on a first image and a kernel comprising one or more weights, set values of the one or more weights based on the second image, and adjust the values of the one or more weights based on positions of the one or more weights in the kernel.

Image processing apparatus performing a deconvolution operation and operation method thereof

Provided is an image processing apparatus for generating a high-resolution image. The image processing apparatus includes a memory storing one or more instructions and a processor configured to execute the one or more instructions stored in the memory, wherein the processor is configured to extract feature information regarding a low-resolution image of a current frame by using a first convolutional neural network, generate, based on the feature information, a first high-resolution image of the current frame, remove flickering of the first high-resolution image by using a high-resolution image of a previous frame, and remove flickering of a high-resolution image of a next frame by using at least one of a flickering-removed second high-resolution image of the current frame, or the feature information.

An electronic device is disclosed. The electronic device of the disclosure comprises: a memory in which a learned artificial intelligence model is stored; and a processor for inputting an input image to the artificial intelligence model and outputting an enlarged image with increased resolution, wherein the learned artificial intelligence model includes an upscaling module for acquiring the pixel values of interpolated pixels around a cell according to a function having a nonlinearly decreasing symmetric form with reference to an original pixel in the enlarged image, the original pixel corresponding to a pixel of the input image.

Electronic device, image processing method, and computer-readable recording medium

An image processing apparatus applies an image to a first learning network model to optimize the edges of the image, applies the image to a second learning network model to optimize the texture of the image, and applies a first weight to the first image and a second weight to the second image based on information on the edge areas and the texture areas of the image to acquire an output image.

Image processing apparatus and image processing method thereof

An artificial intelligence (AI) decoding apparatus obtains image data corresponding to a first image, which is AI-downscaled from an original image by an AI encoding apparatus by using a first deep neural network (DNN); reconstructs a second image corresponding to the first image, based on the image data; and obtain a third image, which is AI-upscaled from the second image, convolution is performed based on the second image and second parameters of a filter kernel included in a second DNN, wherein each of the second parameters is an integer value, and the second parameters are determined as values associated with first parameters of a filter kernel included in the first DNN. Embodiments use memory-efficient values with respect to filter kernels. Parameters used to obtain the memory-efficient integer values may be obtained via joint training between the first DNN and the second DNN.

Artificial intelligence (AI) encoding apparatus and operating method thereof and AI decoding apparatus and operating method thereof

An image providing apparatus configured to generate, by using a first artificial intelligence (AI) network, AI metadata including class information and at least one class map, in which the class information includes at least one class corresponding to a type of an object among a plurality of predefined objects included in a first image and the at least one class map indicates a region corresponding to each class in the first image, generate an encoded image by encoding the first image, and output the encoded image and the AI metadata through the output interface.

Apparatus and method of using AI metadata related to image quality

Provided is an image processing apparatus including a memory storing at least one instruction, and a processor configured to execute the at least one instruction stored in the memory to obtain first feature information by performing a convolution operation on a first image and a first kernel included in a first convolution layer among a plurality of convolution layers, obtain at least one piece of characteristic information, based on the first feature information; obtain second feature information, based on the first feature information and the at least one piece of characteristic information, obtain third feature information by performing a convolution operation on the obtained second feature information and a second kernel included in a second convolution layer that is a layer next to the first convolution layer among the plurality of convolution layers, and obtain an output image, based on the third feature information.

Image processing apparatus and operating method of the same

An image processing apparatus is disclosed. The present image processing apparatus comprises: a memory for storing a low dynamic range (LDR) image and a processor for adjusting the brightness of the LDR image by means of a pixel-specific brightness ratio identified using a first parameter, and acquiring a high dynamic range (HDR) image by adding or subtracting a pixel-specific correction value identified using a second parameter in the brightness-adjusted LDR image.

Growing community of inventors

Suwon-si, South Korea

Jaeyeon Park