The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 05, 2024
Filed:
Sep. 08, 2021
Applicant:
Lionrocket Inc., Seoul, KR;
Inventors:
Assignee:
LIONROCKET INC., Seoul, KR;
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06V 40/16 (2022.01); G06F 18/22 (2023.01); G06N 3/04 (2023.01);
U.S. Cl.
CPC ...
G06V 40/171 (2022.01); G06F 18/22 (2023.01); G06N 3/04 (2013.01); G06V 40/161 (2022.01); G06V 40/172 (2022.01); G06V 40/176 (2022.01);
Abstract
Provided is a mouth shape synthesis device and a method using an artificial neural network. To this end, an original video encoder that encodes original video data which is a target of a mouth shape synthesis as a video including a face of a synthesis target; an audio encoder that encodes audio data that is a basis for the mouth shape synthesis and outputs an audio embedding vector; and a synthesized video decoder that uses the original video embedding vector and the audio embedding vector as input data, and outputs synthesized video data in which a mouth shape corresponding to the audio data is synthesized on the synthesis target face may be provided.