Multi-sensor depth mapping

Abstract

Depth mapping apparatus includes an illumination assembly, which directs modulated optical radiation toward a target scene, and a camera, which captures a two-dimensional image of the target scene. A range sensor senses respective times of flight of photons reflected from a matrix of locations disposed across the target scene. A processor derives first depth coordinates of the matrix of locations responsively to the respective times of flight, derives second depth coordinates of the matrix of locations responsively to a transverse disparity between features in the two-dimensional image and corresponding reference features in a reference image, computes a disparity correction function based on a difference between the first and the second depth coordinates at the matrix of locations, corrects the transverse disparity between the two-dimensional image and the reference image using the disparity correction function, and generates a depth map of the target scene based on the corrected transverse disparity.