Depth estimation using a single near-infrared camera and dot illuminator

Abstract

Provided are computing systems, methods, and platforms for using machine-learned models to generate a depth map. The operations can include projecting, using a dot illuminator, near-infrared (NIR) dots on the scene. The NIR dots can have a uniform pattern. Additionally, the operations can include capturing, using a single NIR camera, the projected NIR dots on the scene. Moreover, the operations can include generating a dot image based on the captured NIR dots on the scene. Furthermore, the operations can include processing the dot image with a machine-learned model to generate a depth map of the scene. Subsequently, the operations can further include evaluating the generated depth map of the scene and a ground truth depth map, and performing an action based on the evaluation.