The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 26, 2023

Filed:

Dec. 22, 2021
Applicant:

Spree3d Corporation, Incline Village, NV (US);

Inventors:

Mohamed N. Moustafa, Metuchen, NJ (US);

Ahmed A. Ewais, New Cairo, EG;

Amr A. Ali, Cairo, EG;

Assignee:

Spree3d Corporation, Incline Village, NV (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06V 40/16 (2022.01); G06V 40/10 (2022.01); G06T 7/246 (2017.01); G06V 10/60 (2022.01); G06N 3/045 (2023.01);
U.S. Cl.
CPC ...
G06V 40/168 (2022.01); G06N 3/045 (2023.01); G06T 7/246 (2017.01); G06V 10/60 (2022.01); G06V 40/103 (2022.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01);
Abstract

Methods and apparati for inserting face and hair information from a source video () into a destination (driver) video () while mimicking pose, illumination, and hair motion of the destination video (). An apparatus embodiment comprises an identity encoder () configured to encode face and hair information of the source video () and to produce as an output an identity vector; a pose encoder () configured to encode pose information of the destination video () and to produce as an output a pose vector; an illumination encoder () configured to encode head and hair illumination of the destination video () and to produce as an output an illumination vector; and a hair motion encoder () configured to encode hair motion of the destination video () and to produce as an output a hair motion vector. The identity vector, pose vector, illumination vector, and hair motion vector are fed as inputs to a neural network generator (). The neural network generator () is configured to generate, in response to the four inputs, a composite video () comprising face and hair information from the source video () inserted into the destination video ().


Find Patent Forward Citations

Loading…