Method and appratus with neural rendering based on view augmentation

Abstract

A method and apparatus for neural rendering based on view augmentation are provided. A method of training a neural scene representation (NSR) model includes: receiving original training images of a target scene, the original training images respectively corresponding to base views of the target scene; generating augmented images of the target scene by warping the original training images, the augmented images respectively corresponding to new views of the target scene; performing background-foreground segmentation on the original training images and the augmented images to generate segmentation masks; and training a neural scene representation (NSR) model to be configured for volume rendering of the target scene by using the original training images, the augmented images, and the segmentation masks.