The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 23, 2024

Filed:

Apr. 15, 2022
Applicant:

Realsee (Beijing) Technology Co., Ltd., Beijing, CN;

Inventor:

Jing Zhao, Beijing, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04N 21/8547 (2011.01); G06N 3/045 (2023.01); G06V 20/40 (2022.01); G06V 40/16 (2022.01); G11B 27/031 (2006.01); G11B 27/10 (2006.01); H04N 21/845 (2011.01);
U.S. Cl.
CPC ...
H04N 21/8547 (2013.01); G06N 3/045 (2023.01); G06V 20/46 (2022.01); G06V 40/165 (2022.01); G11B 27/031 (2013.01); G11B 27/10 (2013.01); H04N 21/8456 (2013.01);
Abstract

Systems and methods for generating a synthetic video based on an audio are provided. An exemplary system may include a memory storing computer-readable instructions and at least one processor. The processor may execute the computer-readable instructions to perform operations. The operations may include receiving a reference video including a motion picture of a human face and receiving the audio including a speech. The operations may also include generating a synthetic motion picture of the human face based on the reference video and the audio. The synthetic motion picture of the human face may include a motion of a mouth of the human face presenting the speech. The motion of the mouth may match a content of the speech. The operations may further include generating the synthetic video based on the synthetic motion picture of the human face.


Find Patent Forward Citations

Loading…