Method and system for enabling exposure-guided three-dimensional reconstruction

Abstract

Disclosed is a method for enabling exposure-guided three-dimensional (3D) reconstruction, including (i) receiving Low Dynamic Range (LDR) input image captured by camera; (ii) rendering High Dynamic Range (HDR) image corresponding to input image, using HDR 3D reconstruction model pre-trained for HDR image reconstruction of 3D environment; (iii) applying HDR to LDR tone-mapping operator on HDR image, for producing tone-mapped LDR image; (iv) determining first loss function (FLF) between input image and tone-mapped LDR image, FLF comprising weighted pixel value differences between pixels of input image and corresponding pixels of tone-mapped LDR image; (v) determining whether input image has saturated pixel(s), saturated pixel(s) comprises: highlight saturated pixel, shadow saturated pixel; (vi) de-weighting pixel value difference corresponding to saturated pixel in FLF; (vii) back-propagating gradient of FLF with respect to model parameters, through differentiable render function of HDR 3D reconstruction model, for adjusting model parameters in way that reduces FLF.