The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 23, 2024
Filed:
Jun. 11, 2020
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Matthew Alastair Johnson, Cambridge, GB;
Marta Malgorzata Wilczkowiak, Cambridge, GB;
Daniel Stephen Wilde, Cambridge, GB;
Paul Malcolm McIlroy, Cambridge, GB;
Tadas Baltrusaitis, Cambridge, GB;
Virginia Estellers Casas, Cambridge, GB;
Marek Adam Kowalski, Cambridge, GB;
Christopher Maurice Mei, Redmond, WA (US);
Stephan Joachim Garbin, London, GB;
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
In various examples there is an apparatus for computing an image depicting a face of a wearer of a head mounted display (HMD), as if the wearer was not wearing the HMD. An input image depicts a partial view of the wearer's face captured from at least one face facing capture device in the HMD. A machine learning apparatus is available which has been trained to compute expression parameters from the input image. A 3D face model that has expressions parameters is accessible as well as a photorealiser being a machine learning model trained to map images rendered from the 3D face model to photorealistic images. The apparatus computes expression parameter values from the image using the machine learning apparatus. The apparatus drives the 3D face model with the expression parameter values to produce a 3D model of the face of the wearer and then renders the 3D model from a specified viewpoint to compute a rendered image. The rendered image is upgraded to a photorealistic image using the photorealiser.