The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 20, 2021

Filed:

Sep. 27, 2019
Applicant:

Apple Inc., Cupertino, CA (US);

Inventors:

Sofien Bouaziz, Los Gatos, CA (US);

Brian Amberg, Zurich, CH;

Thibaut Weise, Menlo Park, CA (US);

Patrick Snape, Zurich, CH;

Stefan Brugger, Basel Land, CH;

Alex Mansfield, Zurich, CH;

Reinhard Knothe, Basel, CH;

Thomas Kiser, Zurich, CH;

Assignee:

Apple Inc., Cupertino, CA (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06T 15/00 (2011.01); G06K 9/00 (2006.01); G06T 17/20 (2006.01);
U.S. Cl.
CPC ...
G06K 9/00281 (2013.01); G06K 9/00261 (2013.01); G06K 9/00315 (2013.01); G06T 17/20 (2013.01);
Abstract

A three-dimensional model (e.g., motion capture model) of a user is generated from captured images or captured video of the user. A machine learning network may track poses and expressions of the user to generate and refine the three-dimensional model. Refinement of the three-dimensional model may provide more accurate tracking of the user's face. Refining of the three-dimensional model may include refining the determinations of poses and expressions at defined locations (e.g., eye corners and/or nose) in the three-dimensional model. The refining may occur in an iterative process. Tracking of the three-dimensional model over time (e.g., during video capture) may be used to generate an animated three-dimensional model (e.g., an animated puppet) of the user that simulates the user's poses and expressions.


Find Patent Forward Citations

Loading…