Samsung Electronics Co., Ltd.

Dongwan Lee

Yongsung Kim

Daehyun Ban

Juyoung Lee

Lei Zhang

Chanwon Seo

Yehoon Kim

Hyunsoo Choi

Sojung Yun

Daehun Kim

Hongpyo Lee

An apparatus is provided. The apparatus includes an input/output interface configured to receive an image and output a result, a memory storing one or more instructions for processing the image by using a convolutional neural network, and a processor configured to process the image by executing the one or more instructions, wherein the convolutional neural network (CNN) may include one or more spatial transformation modules, and the spatial transformation module may include a spatial transformer configured to apply a spatial transform to first input data that is the image or an output of a previous spatial transformation module, by using a spatial transformation function, a first convolutional layer configured to perform a convolution operation between the first input data to which the spatial transform is applied and a first filter, and a spatial inverse transformer configured to apply a spatial inverse transform to an output of the first convolutional layer.

Image processing method and apparatus using convolutional neural network

A server for pose estimation of a person and an operating method of the server are provided. The operating method includes obtaining an original image including a person, generating a plurality of input images by rotating the original image, obtaining first pose estimation results respectively corresponding to the plurality of input images, by inputting the plurality of input images to a pose estimation model, applying weights to the first pose estimation results respectively corresponding to the plurality of input images, and obtaining a second pose estimation result, based on the first pose estimation results to which the weights are applied, wherein the first pose estimation results and the second pose estimation result each include data indicating main body parts of the person.

Server for pose estimation and operating method of the server

A method of operating an image processing apparatus is provided. The method includes generating a first feature map by performing a convolution operation between a first image and a first kernel group, generating a second feature map by performing a convolution operation between the first image and a second kernel group, generating a first combination map based on the first feature map, generating a second combination map based on the first feature map and the second feature map, generating a second image based on the first combination map and the second combination map, and generating a reconstructed image of the first image, based on the second image and the first image, and generating a high-resolution image of the first image by inputting the reconstructed image to an upscaling model.

Image processing apparatus and operating method thereof

Emotion information is obtained by an electronic device in order to improve communication between a person and the electronic device. Multimedia data is obtained regarding a person, predicted values for the person are obtained by applying the multimedia data to neural network models, and emotion information of the person is obtained by applying the predicted values to a weight model. Then, feedback information is obtained from the person with respect to the first emotion information of the person. Finally, the weight model is updated by using the feedback information. Subsequently, when multimedia data are again obtained regarding the person, new predicted values for the person are obtained by applying later multimedia data the plurality of neural network models, and emotion information of the person is again obtained, but this time using the weight model updated using the feedback information.

Electronic device and method of obtaining emotion information

An electronic apparatus is provided. The electronic apparatus includes a display, a camera configured to capture a rear of the electronic apparatus facing a front of the electronic apparatus in which the display displays an image, and a processor configured to render a virtual object based on the image captured by the camera, based on a user body being detected from the captured image, estimate a plurality of joint coordinates with respect to the detected user body using a pre-trained learning model, generate an augmented reality image using the estimated plurality of joint coordinates, the rendered virtual object, and the captured image, and control the display to display the generated augmented reality image, wherein the processor is configured to identify whether the user body touches the virtual object based on the plurality of estimated joint coordinates, and change a transmittance of the virtual object based on the touch being identified.

Growing community of inventors

Suwon-si, South Korea

Dongwan Lee