Google Inc.

Abhi Meka

Paul E Debevec

Sofien Bouaziz

Shahram Izadi

Jonathan James Taylor

Sean Ryan Francesco Fanello

Christoph Rhemann

Rohit Kumar Pandey

Philip L Davidson

Yinda Zhang

Chloe LeGendre

Christian Haene

Daniel William Erickson

Sergio Orts Escolano

Thabo Beeler

Peter Barnum

Ryan Overbeck

Example embodiments relate to techniques for volumetric performance capture with neural rendering. A technique may involve initially obtaining images that depict a subject from multiple viewpoints and under various lighting conditions using a light stage and depth data corresponding to the subject using infrared cameras. A neural network may extract features of the subject from the images based on the depth data and map the features into a texture space (e.g., the UV texture space). A neural renderer can be used to generate an output image depicting the subject from a target view such that illumination of the subject in the output image aligns with the target view. The neural render may resample the features of the subject from the texture space to an image space to generate the output image.

Volumetric performance capture with neural rendering

Growing community of inventors

Redwood City, CA, United States of America

Abhi Meka