The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 07, 2020

Filed:

Mar. 06, 2018
Applicant:

Fotonation Limited, Galway, IE;

Inventors:

Mihai Ciuc, Bucharest, RO;

Stefan Petrescu, Bucharest, RO;

Emanuela Haller, Bucharest, RO;

Florin Oprea, Bucharest, RO;

Alexandru Nicolaescu, Bucharest, RO;

Florin Nanu, Bucharest, RO;

Iulian Palade, Bucharest, RO;

Assignee:

FotoNation Limited, Galway, IE;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06T 7/73 (2017.01); G06T 13/40 (2011.01);
U.S. Cl.
CPC ...
G06T 7/73 (2017.01); G06K 9/00268 (2013.01); G06T 13/40 (2013.01); G06T 2215/16 (2013.01);
Abstract

Tracking units for facial features with advanced training for natural rendering of human faces in real-time are provided. An example device receives a video stream, and upon detecting a visual face, selects a 3D model from a comprehensive set of head orientation classes. The device determines modifications to the selected 3D model to describe the face, then projects a 2D model of tracking points of facial features based on the 3D model, and controls, actuates, or animates hardware based on the facial features tracking points. The device can switch among an example comprehensive set of 35 different head orientation classes for each video frame, based on suggestions computed from a previous video frame or from yaw and pitch angles of the visual head orientation. Each class of the comprehensive set is trained separately based on a respective collection of automatically marked images for that head orientation class.


Find Patent Forward Citations

Loading…