Electronics and Telecommunications Research Institute

The Industry & Academic Cooperation in Chungnam National University (iac)

The Industry & Academic Cooperation in Chungnam National University

Dae-Young Song

Gi Mun Um

Hee-Kyung Lee

Hee Kyung Lee

Dong-Hyeon Cho

Donghyeon Cho

Disclosed herein are a method and apparatus for generating a panoramic image. The method includes configuring a data set for training a deep learning network based on K images, extracting an encoding feature map, a skip connection feature map, and a decoding feature map based on K/2 images, among the images, estimating multiple homographies based on the encoding feature map, estimating a flow adjustment map, a preprocessing blending map, a weight map, and a post-processing blending map based on the decoding feature map, deriving a flow map based on the multiple homographies and the flow adjustment map, generating a preprocessed image based on the preprocessing blending map, generating multiple warped images based on the preprocessed image and the flow map, generating a matching image based on the warped images and the weight map, and correcting the matching image based on the matching image and the post-processing blending map.

Method and apparatus for generating panoramic image based on deep learning network

A deep learning-based image stitching method and apparatus are provided. The deep learning-based image stitching method includes receiving a plurality of images including a first image and a second image stitched to the first image, extracting a feature map of the plurality of images, generating a plurality of flow maps indicating movement information of pixels of the plurality of images, based on the feature map, generating a plurality of warping images in which the pixels of the plurality of images are moved, by applying the plurality of flow maps to the plurality of images, respectively, generating a plurality of weight maps for blending the plurality of warping images, based on the feature map, and generating a stitch image in which the first image and the second image are stitched, by blending the plurality of warping images based on the plurality of weight maps.

Deep learning-based image stitching method and apparatus

Growing community of inventors

Daejeon, South Korea

Dae-Young Song