Residual error mitigation in multiview calibration

Abstract

Multiview calibration is essential for accurate three-dimensional computation. However, multiview calibration cannot be accurate enough because of the tolerances required in some of the intrinsic and extrinsic parameters that are associated with the calibration process, along with fundamental imperfections that are associated with the manufacturing and assembly process itself. As a result, residual error in calibration is left over, with no known methods to mitigate such errors. Residual error mitigation of the invention may be performed inline with a given calibration approach, or as a secondary processing step. Residual error mitigation aims at modifying the original parameters that have been estimated during an initial calibration process. These new, modified parameters are then used for triangulation and depth estimation of scene information. This approach also resolves parameter tolerances that are either too cumbersome to measure, or otherwise impossible to measure for practical stereo and multiview camera production and calibration applications.