Disney Enterprises, Inc.

Martin Klaudiny

Kenneth John Mitchell

Malgorzata Edyta Kosek

Ivan Huerta Casado

Charles Malleson

Derek Edward Bradley

Thabo D Beeler

Iain Matthews

Steven G McDonagh

Presented herein are systems and methods configured to generate virtual entities representing real-world users. In some implementations, the systems and/or methods are configured to capture user appearance information with imaging devices and sensors, determines correspondence values conveying correspondences between the appearance of the user's body or user's head and individual ones of default body models and/or default head models, modifies a set of values defining a base body model and/or base head model based on determined correspondence values and sets of base values defining the default body models and/or default head models. The base body model and/or base head model may be modified to model the appearance of the body and/or head of the user.

Single shot capture to animated VR avatar

Single shot capture to animated vr avatar

Provided are methods, systems, and computer-readable medium for synthetically generating training data to be used to train a learning algorithm that is capable of generating computer-generated images of a subject from real images that include the subject. The training data can be generated using a facial rig by changing expressions, camera viewpoints, and illumination in the training data. The training data can then be used for tracking faces in a real-time video stream. In such examples, the training data can be tuned to expected environmental conditions and camera properties of the real-time video stream. Provided herein are also strategies to improve training set construction by analyzing which attributes of a computer-generated image (e.g., expression, viewpoint, and illumination) require denser sampling.

Markerless face tracking with synthetic priors

Growing community of inventors

Zilina, Slovakia

Martin Klaudiny