Meta Platforms, Inc.

Benjamin Attal

Michael Zollhoefer

Johannes Peter Kopf

Changil Kim

Jia-Bin Huang

In particular embodiments, a computing system may access a set of training images for training a neural light field network for view synthesis. Using each training image, the computing system may train the neural light field network by casting, for each pixel of the training image, a ray into a three-dimensional (3D) space, the ray including integrated radiance along the ray, mapping first ray coordinates of the ray into an embedding network, transforming, using the embedding network, the first ray coordinates into second ray coordinates, applying positional encoding to second ray coordinates, generating, using the neural light field network, a predicted color value for the pixel based on positionally encoded second ray coordinates, comparing the predicted color value for the pixel with a ground-truth color value for the pixel, and updating the neural light field network and the embedding network based on comparison.

Growing community of inventors

Pittsburgh, PA, United States of America

Benjamin Attal