Lucasfilm Entertainment Company Ltd.

Yuting Ye

Kiran Bhat

Michael Koperwas

Ronald Mallet

Adrian R Goldenthal

Rachel Rose

Hao Li

Scott R Jones

Christoph Bregler

Jihun Yu

A system includes a computing device that includes a memory configured to store instructions. The system also includes a processor configured to execute the instructions to perform a method that includes receiving multiple representations of an object. Each of the representations includes position information of the object and corresponds to an instance in time. For at least one of the representations, the method includes defining a contour that represents a movable silhouette of a surface feature of the object. The method also includes producing a deformable model of the surface of the object from the defined contour and from the at least one representation of the object.

Facial animation models

Systems and techniques are provided for transferring changes in animation data between geometric models of a character having different resolutions. For example, systems and techniques are provided for transferring changes in geometric properties between the geometric models. A method may include obtaining a first geometric model of the character and a second geometric model of the character, the geometric models having different resolutions with different numbers of data points. The method may further include determining one or more correspondences between data points of the first geometric model and data points of the second geometric model. The correspondences include one or more data points of the first geometric model that overlap with one or more data points of the second geometric model. The method may further include determining a feature change in the first geometric model, which includes a change in a geometric property of at least one data point of the first geometric model relative to an initial geometric property of the at least one data point prior to the change. The method may further include transferring the feature change in the first geometric model to the second geometric model using the one or more correspondences, including interpolating a change in a geometric property of at least one data point of the second geometric model.

Animation data transfer between geometric models and associated animation models

Techniques for facial performance capture using an adaptive model are provided herein. For example, a computer-implemented method may include obtaining a three-dimensional scan of a subject and a generating customized digital model including a set of blendshapes using the three-dimensional scan, each of one or more blendshapes of the set of blendshapes representing at least a portion of a characteristic of the subject. The method may further include receiving input data of the subject, the input data including video data and depth data, tracking body deformations of the subject by fitting the input data using one or more of the blendshapes of the set, and fitting a refined linear model onto the input data using one or more adaptive principal component analysis shapes.

Real-time performance capture with on-the-fly correctives

Growing community of inventors

San Francisco, CA, United States of America

Yuting Ye