Lucasfilm Entertainment Company Ltd.

Ronald Fedkiw

Nicholas Grant Rasmussen

Lana Lan

Matthew Cong

Cary Phillips

Leandro F Estebecorena

Pablo Helman

Jeffery Bruce Yost

Per Karefelt

Stéphane Grabli

Michael Bao

Adam Ferrall-Nunge

Stephane Grabli

Jeffery Yost

Leandro Estebecorena

Some implementations of the disclosure are directed to techniques for facial reconstruction from a sparse set of facial markers. In one implementation, a method comprises: obtaining data comprising a captured facial performance of a subject with a plurality of facial markers; determining a three-dimensional (3D) bundle corresponding to each of the plurality of facial markers of the captured facial performance; using at least the determined 3D bundles to retrieve, from a facial dataset comprising a plurality of facial shapes of the subject, a local geometric shape corresponding to each of the plurality of the facial markers; and merging the retrieved local geometric shapes to create a facial reconstruction of the subject for the captured facial performance.

Obtaining high resolution and dense reconstruction of face from sparse facial markers

A method of transferring a facial expression from a subject to a computer generated character that includes receiving a plate with an image of the subject's facial expression, a three-dimensional parameterized deformable model of the subject's face where different facial expressions of the subject can be obtained by varying values of the model parameters, a model of a camera rig used to capture the plate, and a virtual lighting model that estimates lighting conditions when the image on the plate was captured. The method can solve for the facial expression in the plate by executing a deformation solver to solve for at least some parameters of the deformable model with a differentiable renderer and shape from shading techniques, using, as inputs, the three-dimensional parameterized deformable model, the model of the camera rig and the virtual lighting model over a series of iterations to infer geometry of the facial expression and generate a final facial mesh using the set of parameter values of the deformable model which result in a facial expression that closely matches the expression of the subject in the plate.

On-set facial performance capture and transfer to a three-dimensional computer-generated model

The movement of elements through a region of three dimensional (3D) space is simulated by utilizing a number of two dimensional (2D) grids to define the region of 3D space. Movement information is associated with each grid point of each 2D grid, and changed over a time period. For each element in 3D space, movement information is interpolated from the grid points of a pair of 2D grids that lie on opposite sides of the element. The interpolated movement information is used to advect the elements through the region of 3D space.

Apparatus and method of simulating the movement of elements through a region of 3D space

Growing community of inventors

Sunnyvale, CA, United States of America

Ronald Fedkiw