System and method for surface properties reconstruction and positioning of digitized 3d objects

Abstract

A method for generating a virtual scene comprising one or more 3D objects is provided. The method includes creating a 3D model of a real world 3D scene, capturing an image of the real world 3D scene by a physical camera to obtain a captured image, creating a digital camera model of the physical camera, rendering a virtual 3D scene comprising virtual 3D objects based on the digital camera model using physical-based rendering software to obtain a virtual image, and minimizing dissimilarity norm between the captured image and the virtual image to optimize positions and surface parameters of the virtual 3D objects in the virtual 3D scene.