Method and apparatus for rebuilding relightable implicit human body model

Abstract

The present invention discloses a method and an apparatus for rebuilding a relightable implicit human body model. A human body is represented as a deformable implicit neural representation, and a geometric shape, material attributes, and ambient lighting of the human body are decomposed to obtain a relightable and drivable implicit human body model. In addition, a volumetric lighting grid including a plurality of spherical Gaussian models is introduced to represent complex lighting with spatial variation, and visible probes capable of changing in position with change in human pose are introduced to record dynamic self-occlusion caused by human motion. With the method, drivable implicit models capable of being used for high-fidelity human body relighting may be generated in cases of sparse video input and even monocular input.