The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 27, 2025

Filed:

May. 26, 2023
Applicant:

Ubtech Robotics Corp Ltd, Shenzhen, CN;

Inventors:

Wan Ding, Shenzhen, CN;

Dongyan Huang, Shenzhen, CN;

Linhuang Yan, Shenzhen, CN;

Zhiyong Yang, Shenzhen, CN;

Assignee:

UBTECH ROBOTICS CORP LTD, Shenzhen, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 13/20 (2011.01); G06T 13/40 (2011.01); G06V 40/20 (2022.01); G10L 13/02 (2013.01); G10L 13/08 (2013.01); G10L 21/10 (2013.01);
U.S. Cl.
CPC ...
G06T 13/40 (2013.01); G06T 13/205 (2013.01); G06V 40/20 (2022.01); G10L 13/02 (2013.01); G10L 13/08 (2013.01); G10L 2021/105 (2013.01);
Abstract

A method for generating a talking head video includes: obtaining a text and an image containing a face of a user; determining a phoneme sequence that corresponds to the text and includes one or more phonemes; determining acoustic features corresponding to the text according to the phoneme sequence, and obtaining synthesized speech corresponding to the text according to the acoustic features; determining a first mouth movement sequence corresponding to the text according to the phoneme sequence, and determining a second mouth movement sequence corresponding to the text according to the acoustic features; creating a facial action video corresponding to the user according to the first mouth movement sequence, the second mouth movement sequence and the image; and processing the synthesized speech and the facial action video synchronously to obtain a talking head video corresponding to the user.


Find Patent Forward Citations

Loading…