Method for 3d scene dense reconstruction based on monocular visual slam

Abstract

The present invention provides a method of dense 3D scene reconstruction based on monocular camera and belongs to the technical field of image processing and computer vision, which builds the reconstruction strategy with fusion of traditional geometry-based depth computation and convolutional neural network (CNN) based depth prediction, and formulates depth reconstruction model solved by efficient algorithm to obtain high-quality dense depth map. The system is easy to construct because of its low requirement for hardware resources and achieves dense reconstruction only depending on ubiquitous monocular cameras. Camera tracking of feature-based SLAM provides accurate pose estimation, while depth reconstruction model with fusion of sparse depth points and CNN-inferred depth achieves dense depth estimation and 3D scene reconstruction; The use of fast solver in depth reconstruction avoids solving inversion of large-scale sparse matrix, which improves running speed of the algorithm and ensures the real-time dense 3D scene reconstruction based on monocular camera.