The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 07, 2020
Filed:
Jan. 04, 2019
Facebook Technologies, Llc, Menlo Park, CA (US);
Yaser Sheikh, Pittsburgh, PA (US);
Hernan Badino, Pittsburgh, PA (US);
Jason Saragih, Pittsburgh, PA (US);
Shih-En Wei, Pittsburgh, PA (US);
Alexander Trenor Hypes, Pittsburgh, PA (US);
Dawei Wang, Pittsburgh, PA (US);
Mohsen Shahmohammadi, Pittsburgh, PA (US);
Michal Perdoch, Pittsburgh, PA (US);
Facebook Technologies, LLC, Menlo Park, CA (US);
Abstract
A virtual reality (VR) or augmented reality (AR) head mounted display (HMD) includes various image capture devices that capture images of portions of the user's face. Through image analysis, points of each portion of the user's face are identified from the images and their movement is tracked. The identified points are mapped to a three dimensional model of a face. From the identified points, a blendshape vector is determined for each captured image, resulting in various vectors indicating the user's facial expressions. A direct expression model that directly maps images to blendshape coefficients for a set of facial expressions based on captured information from a set of users may augment the blendshape vector in various embodiments. From the blendshape vectors and transforms mapping the captured images to three dimensions, the three dimensional model of the face is altered to render the user's facial expressions.