The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 16, 2021

Filed:

Sep. 29, 2020
Applicant:

Tata Consultancy Services Limited, Mumbai, IN;

Inventors:

Sanjana Sinha, Kolkata, IN;

Sandika Biswas, Kolkata, IN;

Brojeshwar Bhowmick, Kolkata, IN;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 13/20 (2011.01); G10L 15/02 (2006.01); G06K 9/62 (2006.01); G06K 9/00 (2006.01); G06T 13/40 (2011.01);
U.S. Cl.
CPC ...
G06T 13/205 (2013.01); G06K 9/00281 (2013.01); G06K 9/6215 (2013.01); G06T 13/40 (2013.01); G10L 15/02 (2013.01);
Abstract

Speech-driven facial animation is useful for a variety of applications such as telepresence, chatbots, etc. The necessary attributes of having a realistic face animation are: 1) audiovisual synchronization, (2) identity preservation of the target individual, (3) plausible mouth movements, and (4) presence of natural eye blinks. Existing methods mostly address audio-visual lip synchronization, and synthesis of natural facial gestures for overall video realism. However, existing approaches are not accurate. Present disclosure provides system and method that learn motion of facial landmarks as an intermediate step before generating texture. Person-independent facial landmarks are generated from audio for invariance to different voices, accents, etc. Eye blinks are imposed on facial landmarks and the person-independent landmarks are retargeted to person-specific landmarks to preserve identity related facial structure. Facial texture is then generated from person-specific facial landmarks that helps to preserve identity-related texture.


Find Patent Forward Citations

Loading…