Sony Corporation

Sony Taiwan Limited

Benjamin Kuo

Tatsumi Mitsushita

Patrick Pan

Christine Lin

The invention provides a method for improving image stitching accuracy and a device for implementing the same, which apply to the multi-camera system for wide-angle image generation. Lens distortion causes mismatches of the features in the overlapping region of the images captured by the multi-camera system. As a result, the mismatches on the stitched wide-angle image are visible. The method and device for improving image stitching accuracy correct the lens distortion before stitching the images captured by the multi-camera system, so that the features in the overlapping region are matched and a seamless wide-angle image is generated by the stitching engine.

Method for improving image stitching accuracy with lens distortion correction and device for implementing the same

The invention discloses an optimized video stitching method, comprising: inputting predefined pattern images; proceeding with a transformation which combines planar and cylindrical transformation; proceeding with a merging calculation which combines linear difference merging and alpha blending calculation; and proceeding with a horizontal stitching processing by putting the processed images horizontally together into one seamless wide-angle image. The optimized video stitching method according to the invention further comprises a camera position calibration flow comprising: finding a planar matrix by using predefined pattern images; proceeding with a planar transformation of image; proceeding with an image registration by using a block matching method to find out the stitching points on the planar surface; and proceeding with a cylindrical transformation by transforming the stitching points from the planar surface to cylindrical surface.

Growing community of inventors

Taipei, Taiwan

Benjamin Kuo