The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 29, 2020

Filed:

Jan. 18, 2019
Applicant:

Snap Inc., Santa Monica, CA (US);

Inventors:

Pavel Savchenkov, Sochi, RU;

Dmitry Matov, Sochi, RU;

Aleksandr Mashrabov, Sochi, RU;

Alexey Pchelnikov, Sochi, RU;

Assignee:

Snap Inc., Santa Monica, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06T 11/00 (2006.01); G06Q 30/02 (2012.01); G06N 3/04 (2006.01);
U.S. Cl.
CPC ...
G06K 9/00228 (2013.01); G06K 9/00302 (2013.01); G06N 3/04 (2013.01); G06Q 30/0254 (2013.01); G06Q 30/0269 (2013.01); G06T 11/001 (2013.01); G06K 2009/00322 (2013.01);
Abstract

Provided are systems and a method for photorealistic real-time face reenactment. An example method includes receiving a target video including a target face and a source video including a source face. The method includes determining, based on the target face, a target facial expression. The method includes determining, based on the source face, a source facial expression. The method includes synthesizing, using the parametric face model, an output face. The output face including the target face wherein the target facial expression is modified to imitate the source facial expression. The method includes generating, based on a deep neural network, mouth and eyes regions, and combining the output face, the mouth, and eyes regions to generate a frame of an output video.


Find Patent Forward Citations

Loading…