The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 04, 2017

Filed:

May. 03, 2011
Applicants:

Lijuan Wang, Beijing, CN;

Frank Soong, Beijing, CN;

Qiang Huo, Beijing, CN;

Zhengyou Zhang, Bellevue, WA (US);

Inventors:

Lijuan Wang, Beijing, CN;

Frank Soong, Beijing, CN;

Qiang Huo, Beijing, CN;

Zhengyou Zhang, Bellevue, WA (US);

Assignee:
Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06T 13/40 (2011.01); G10L 21/10 (2013.01);
U.S. Cl.
CPC ...
G06T 13/40 (2013.01); G10L 21/10 (2013.01); G10L 2021/105 (2013.01);
Abstract

Dynamic texture mapping is used to create a photorealistic three dimensional animation of an individual with facial features synchronized with desired speech. Audiovisual data of an individual reading a known script is obtained and stored in an audio library and an image library. The audiovisual data is processed to extract feature vectors used to train a statistical model. An input audio feature vector corresponding to desired speech with which the animation will be synchronized is provided. The statistical model is used to generate a trajectory of visual feature vectors that corresponds to the input audio feature vector. These visual feature vectors are used to identify a matching image sequence from the image library. The resulting sequence of images, concatenated from the image library, provides a photorealistic image sequence with facial features, such as lip movements, synchronized with the desired speech. This image sequence is applied to the three-dimensional model.


Find Patent Forward Citations

Loading…