Samsung Electronics Co., Ltd.

Korea Advanced Institute of Science and Technology

Hwa Sup Lim

Kee Chang Lee

Byong Min Kang

Seung Kyu Lee

Ouk Choi

Yong Sun Kim

Do Kyoon Kim

Seong Jin Kim

Sun Hyuck Chae

Jae Joon Han

Won Chul Bang

Haibing Ren

Chang Yeong Kim

Jae Young Sim

Byong-Min Kang

Sung Cheol Kim

Anton Sergeevich Konushin

Xiangsheng Huang

Olga Barinova

Hye Yeon Shim

Jeong Ho Han

Kassou Ahmad Ramez

Vadim Sergeevich Konushin

Anton Anatolyevich Yakubenko

In Cheol Park

A depth noise filtering method and apparatus is provided. The depth noise filtering method may perform spatial filtering or temporal filtering according to depth information. In order to perform spatial filtering, the depth noise filtering method may determine a characteristic of a spatial filter based on depth information. Also, in order to perform temporal filtering, the depth noise filtering method may determine a number of reference frames based on depth information. The depth noise filtering method may adaptively remove depth noise according to depth information and thereby enhance a noise filtering performance.

Method, medium, and apparatus of filtering depth noise using depth information

Provided are an apparatus and a method for high speed filtering of an image for high precision that may include a coordinate determining unit to determine coordinates (P,Q) on a screen with respect to a first pixel to be filtered, a pixel determining unit to determine a second pixel with coordinates including either P or Q, a block setting unit to set a first block comprising the first pixel, and a second block comprising the second pixel, and a processing unit to filter the first pixel by comparing the first block and the second block.

Apparatus and method for high speed filtering of image for high precision

An apparatus and method for bidirectionally inpainting an occlusion area appearing during generation of a virtual viewpoint image, using a foreground area and a background area based on a predicted volume are provided. The method includes receiving an input of a depth image and a color image, the depth image having depth information for a first viewpoint, and the color image having color information for the first viewpoint, generating a virtual viewpoint image at a second viewpoint based on the depth image and the color image, separating the virtual viewpoint image into a foreground area and a background area, based on the depth information and direction information regarding a direction from the first viewpoint to the second viewpoint, predicting a three-dimensional (3D) volume of the foreground area, and inpainting an occlusion area bidirectionally using the foreground area and the background area, based on the predicted 3D volume, the occlusion area being included in the virtual viewpoint image.

Apparatus and method for bidirectionally inpainting occlusion area based on predicted volume

A first calculator of an image processing apparatus may trace a view transform vector between color images of different frames. A second calculator may trace a view transform vector between depth images of different frames. In this example, a third calculator may calculate a view transform vector between the color camera and the depth camera using the view transform vector between the color images and the view transform vector between the depth images.

Image processing apparatus and method

An image processing apparatus may include a sensor unit which generates both a color image and a depth image. A color-depth time difference correcting unit may correct a mismatching that occurs due to a time difference between a point in time when the color image is generated and a point in time when the depth image is generated. An image generator may generate a stereoscopic image or a multi-view image using the color image and the depth image after the mismatching is corrected.

Provided is a depth image generating apparatus. The depth image generating apparatus may include a filtering unit, a modulation unit, and a sensing unit. The filtering unit may band pass filter an infrared light of a first wavelength band among infrared lights received from an object. The modulation unit may modulate the infrared light of the first wavelength band to an infrared light of a second wavelength band. The sensing unit may generate an electrical signal by sensing the modulated infrared light of the second wavelength band.

Apparatus and method for generating depth image

A method and apparatus for temporally interpolating a three-dimensional (3D) depth image are provided to generate an intermediate depth image in a desired time. The apparatus may interpolate depth images generated by a depth camera, using a temporal interpolation procedure, may generate an intermediate depth image in a new time using the interpolated depth images, and may combine the generated intermediate depth image with color images, to generate a high-precision 3D image.

Method and apparatus for temporally interpolating three-dimensional depth image

An image processing apparatus and method are provided. A control unit may divide input image array data into a plurality of sub-blocks, and a first arithmetic logic unit (ALU) may generate an integral image of at least one of the plurality of sub-blocks. The control unit may determine each of the plurality of sub-blocks to be included in any one of a first sub-block group and a second sub-block group, store the integral image of each sub-block included in the first sub-block group on the first memory, and store the integral image of each sub-block included in the second sub-block group on the second memory.

Image processing apparatus and method for determining the integral image

A high speed filtering apparatus and a method for high precision restoration of a depth image are provided. The high speed filtering apparatus for high precision restoration of the depth image may include a block setting unit to set a first block including a target pixel, and to set a second block with respect to a central pixel distributed around the target pixel based on a size of the first block, a weight determining unit to determine a pixel weight with respect to each pixel in the second block, and to determine a block weight with respect to the second block by applying the pixel weight, and a processor to filter the target pixel based on the block weight, thereby accurately filtering the target pixel.

Filtering apparatus and method for high precision restoration of depth image

Provided are an apparatus and method for converting a low-resolution depth image to a depth image having a resolution identical to a resolution of a high-resolution color image. The depth image conversion apparatus may generate a discrete depth image by quantizing a depth value of an up-sampled depth image, estimate a high-resolution discrete depth image by optimizing an objective functions of the discrete depth image based on the high-resolution color image and an up-sampled depth border, and convert the up-sampled depth image to a high-resolution depth image by filtering the up-sampled depth image when a difference between discrete depth values of neighboring pixels in the high-resolution discrete depth image is less than a predetermined threshold value.

Depth image conversion apparatus and method

Disclosed is a mesh generating apparatus, method and computer-readable medium, and an image processing apparatus, method and computer-readable medium. A single 3D mesh and a single 3D object model may be generated using a single color image and a single depth image. A plurality of viewpoint images seen from a plurality of viewpoints may be generated from a single 3D object model.

Mesh generating apparatus, method and computer-readable medium, and image processing apparatus, method and computer-readable medium

An image processing apparatus is provided. A silhouette extractor may extract a silhouette image of a target object from an input depth image. A first calculator may determine a location of at least one limb of the target object and a location of at least one joint connecting the at least one limb by applying a rectangle fitting algorithm with respect to the silhouette image.

Provided is an image processing apparatus, medium, and method. The image processing apparatus may include a first calculator and a second calculator. The first calculator may calculate a first weight of a first frame depth value of a first pixel of a depth image and a second weight of a second frame depth value of the first pixel, based on an obtainment time difference between the first frame depth value of the first pixel and the second frame depth value of the first pixel among a plurality of frame depth values of the first pixel. The second calculator may determine a corrected first frame depth value of the first pixel using a linear sum that is calculated by applying the first weight to the first frame depth value of the first pixel, and by applying the second weight to the second frame depth value of the first pixel.

Image processing apparatus, medium, and method

Disclosed is a 3D face capturing apparatus, method and computer-readable medium. As an example, the 3D face capturing method includes obtaining a face color image, obtaining a face depth image, aligning, by a computer, the face color image and the face depth image, obtaining, by the computer, a 3D face model by 2D modeling of the face color image and covering a modeled 2D face area on an image output by an image alignment module, removing by the computer, depth noise of the 3D face model, and obtaining, by the computer, an accurate 3D face model by aligning the 3D face model and a 3D face template, and removing residual noise based on a registration between the 3D face model and the 3D face template.

Three-dimensional face capturing apparatus and method and computer-readable medium thereof

Provided is an image processing apparatus. The image processing apparatus may extract a three-dimensional (3D) silhouette image in an input color image and/or an input depth image. Motion capturing may be performed using the 3D silhouette image and 3D body modeling may be performed.

Growing community of inventors

Hwaseong-si, South Korea

Hwa Sup Lim