Fyusion, Inc.

Srinivas Rao

Stefan Johannes Josef Holzer

Rodrigo Ortiz-Cayon

Matteo Munaro

Krunal Ketan Chande

Aidas Liaudanskas

Yusuke Tomoto

Tobias Bertel

Christian Richardt

Nishant Rai

One or more two-dimensional images of a three-dimensional object may be analyzed to estimate a three-dimensional mesh representing the object and a mapping of the two-dimensional images to the three-dimensional mesh. Initially, a correspondence may be determined between the images and a UV representation of a three-dimensional template mesh by training a neural network. Then, the three-dimensional template mesh may be deformed to determine the representation of the object. The process may involve a reprojection loss cycle in which points from the images are mapped onto the UV representation, then onto the three-dimensional template mesh, and then back onto the two-dimensional images.

Weak multi-view supervision for surface mapping estimation

Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.

Deferred neural rendering for view extrapolation

Growing community of inventors

San Francisco, CA, United States of America

Srinivas Rao