Vidiator Enterprises Inc.

Nevengineering, Inc.

Karin M Derlich

Hartmut Neven

Ulrich Franz Buddemeier

Yevgeniy V Dzhurinskiy

Frank Paetzold

Facial animation values are generated using a sequence of facial image frames and synchronously captured audio data of a speaking actor. In the technique, a plurality of visual-facial-animation values are provided based on tracking of facial features in the sequence of facial image frames of the speaking actor, and a plurality of audio-facial-animation values are provided based on visemes detected using the synchronously captured audio voice data of the speaking actor. The plurality of visual facial animation values and the plurality of audio facial animation values are combined to generate output facial animation values for use in facial animation.

Method and system for generating facial animation values based on a combination of visual and audio information

The present invention provides a technique for translating facial animation values to head mesh positions for rendering facial features of an animated avatar. In the method, an animation vector of dimension Nis provided. Nis the number of facial animation values in the animation vector. A mapping algorithm F is applied to the animation vector to generate a target mix vector of dimension M. M is the number of targets associated with the head mesh positions. The head mesh positions are deformed based on the target mix vector.

Method for mapping facial animation values to head mesh positions

The present invention provides a technique for translating an animation vector to a target mix vector.

Growing community of inventors

Culver City, CA, United States of America

Karin M Derlich