Electronics and Telecommunications Research Institute

University-Industry Cooperation Group of Kyung Hee University

Poznan University of Technology

Industry-University Cooperation Foundation Hanyang University

Pusan National University

Gwang Soon Lee

Kug Jin Yun

Jun Young Jeong

Nam Ho Hur

Hong Chang Shin

Ho Min Eum

Gwang Hoon Park

Gun Bang

Young Su Heo

Soo In Lee

Won Sik Cheong

Yoon Jin Lee

Kyung Yong Kim

Hyoung Jin Kwon

Marek Domanski

Joon Soo Kim

Jin Woong Kim

Hyun Jae Lee

Chie Teuk Ahn

Hyun Jun Lee

Jong Il Park

Hyun Cheol Kim

Heung Mook Kim

Jin Young Lee

Chan Soo Kim

Jong Soo Lim

Namho Hur

Yun Jeong Song

Hyoung Soo Lim

Sang Woon Kwak

Young Su Kim

Joungil Yun

Jae Hyun Seo

Eung Don Lee

Olgierd Stankiewicz

Jakub Stankowski

Min Seong Lee

Joung Il Yun

Dawid Mieloch

Woo Woen Gwun

Jun Ho Kim

Adrian Dziembowski

Bong Ho Lee

Jae Hwui Bae

Jae-Hwui Bae

Hyun Jeong Yim

Kwanghee Jung

Kwan Jung Oh

Jun Young Yun

Hong-Chang Shin

Kwang-Yong Kim

Kyu Tae Yang

Adam Grzelka

Marek Domański

Błazej Szydełko

Dominika Klóska

Seok Jong Hong

Kwang Hee Jung

Tae Jin Jung

Sung Jae Yoon

Seomee Choi

Ho Jun Kim

Ju Yeun Kim

Hyung Nam Kim

Ki Hwan Suh

A method of processing an immersive video includes classifying each of a plurality of objects included in a view image as one of a first object group and a second object group, acquiring a patch for each of the plurality of objects, and packing patches to generate at least one atlas. In this instance, patches derived from objects belonging to the first object group may be packed in a different region or a different atlas from a region or an atlas of patches derived from objects belonging to the second object group.

Method for decoding immersive video and method for encoding immersive video

A method of encoding an immersive image according to the present disclosure comprises classifying a plurality of view images into a basic image and an additional image, generating a plurality of texture atlases based on the plurality of view images, generating a first depth atlas including depth information of view images included in a first texture atlas among the plurality of texture atlases, and generating a second depth atlas including depth information of view images included in remaining texture atlases other than the first texture atlas.

A method is for encoding/decoding an immersive image, and the method for encoding an immersive image may include extracting an invalid region from an already encoded atlas and encoding a current atlas by referring to the invalid region.

Encoding and decoding method and apparatus for immersive video

A method of processing an immersive video includes classifying view images into a basic image and an additional image, performing pruning with respect to view images by referring to a result of classification, generating atlases based on a result of pruning, generating a merged atlas by merging the atlases into one atlas, and generating configuration information of the merged atlas.

Method of processing immersive video and method of producing immersive video

A method of producing an immersive video comprises decoding an atlas, parsing a flag for the atlas, and producing a viewport image using the atlas. The flag may indicate whether the viewport image is capable of being completely produced through the atlas, and, according to a value of the flag, when the viewport image is produced, it may be determined whether an additional atlas is used in addition to the atlas.

Method for processing immersive video and method for producing immersive video

Disclosed herein a device tracking gaze and method therefor. The device includes: an image acquisition unit configured to obtain an eyeball image; a pupil detection unit configured to detect a center of pupil by using the eyeball image; a virtual corneal reflection light position generator configured to process the eyeball image so that a virtual corneal reflection light is located at a predetermined point in the eyeball image; and a PCVR vector generator configured to generate a pupil center virtual reflection vector (PCVR vector) based on a position of the pupil center and a position of the virtual corneal reflection light.

Device tracking gaze and method therefor

A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for input videos; extracting patches from the input videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include information on a priority order of pruning among input videos.

A video encoding method of encoding a multi-view image including one or more basic view images and a plurality of reference view images includes determining a pruning order of the plurality of reference view images, acquiring a plurality of residual reference view images, by pruning the plurality of reference view images based on the one or more basic view images according to the pruning order, encoding the one or more basic view images and the plurality of residual reference view images, and outputting a bitstream including encoding information of the one or more basic view images and the plurality of residual reference view images.

Video encoding method and video decoding method

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.

An immersive video processing method according to the present disclosure includes determining a priority order of pruning for source view videos, generating a residual video for an additional view video based on the priority order of pruning, packing a patch generated based on the residual video into an atlas video, and encoding the atlas video.

An immersive video processing method according to the present invention includes: classifying view videos into a base video and an additional video; performing pruning for the view videos by referring to a result of the classification; generating an atlas based on a result of the pruning; determining a depth parameter of each view in the atlas; and encoding information indicating whether or not updating of the depth parameter is needed, based on whether or not the depth parameter of each view in the atlas is identical as in a previous atlas.

Method for processing immersive video and method for producing immversive video

Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing a patch, which is generated based on the residual video, into an atlas video, and generating metadata for the patch.

Disclosed herein is an immersive video formatting method and apparatus for supporting motion parallax, The immersive video formatting method includes acquiring a basic video at a basic position, acquiring a multiple view video at at least one position different from the basic position, acquiring at least one residual video plus depth (RVD) video using the basic video and the multiple view video, and generating at least one of a packed video plus depth (PVD) video or predetermined metadata using the acquired basic video and the at least one RVD video.

Method and apparatus for immersive video formatting

Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include first threshold information that becomes a criterion for distinguishing between a valid pixel and an invalid pixel in the atlas video.

Growing community of inventors

Daejeon, South Korea

Gwang Soon Lee