The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 23, 2019

Filed:

Jun. 07, 2017
Applicant:

Google Inc., Mountain View, CA (US);

Inventors:

Christian Frueh, Mountain View, CA (US);

Vivek Kwatra, Bangalore, IN;

Avneesh Sud, Mountain View, CA (US);

Assignee:

GOOGLE LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 3/01 (2006.01); G06K 9/00 (2006.01); G06T 7/73 (2017.01); G02B 27/01 (2006.01); G06F 17/30 (2006.01); G06T 15/04 (2011.01); G06T 15/40 (2011.01); G06T 17/00 (2006.01); G06T 17/20 (2006.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01); G06T 7/246 (2017.01);
U.S. Cl.
CPC ...
G06T 17/205 (2013.01); G02B 27/0172 (2013.01); G06F 3/013 (2013.01); G06F 17/3025 (2013.01); G06F 17/3028 (2013.01); G06F 17/30256 (2013.01); G06K 9/00255 (2013.01); G06K 9/00288 (2013.01); G06K 9/00604 (2013.01); G06T 7/248 (2017.01); G06T 7/74 (2017.01); G06T 15/04 (2013.01); G06T 15/40 (2013.01); G06T 17/00 (2013.01); G06T 19/006 (2013.01); G06T 19/20 (2013.01); G06T 2200/04 (2013.01); G06T 2200/08 (2013.01); G06T 2207/10028 (2013.01); G06T 2207/30201 (2013.01); G06T 2207/30204 (2013.01); G06T 2219/2004 (2013.01); G06T 2219/2021 (2013.01);
Abstract

A camera captures an image of a user wearing a head mounted device (HMD) that occludes a portion of the user's face. A three-dimensional (3-D) pose that indicates an orientation and a location of the user's face in a camera coordinate system is determined. A representation of the occluded portion of the user's face is determined based on a 3-D model of the user's face. The representation replaces a portion of the HMD in the image based on the 3-D pose of the user's face in the camera coordinate system. In some cases, the 3-D model of the user's face is selected from 3-D models of the user's face stored in a database that is indexed by eye gaze direction. Mixed reality images can be generated by combining virtual reality images, unoccluded portions of the user's face, and representations of an occluded portion of the user's face.


Find Patent Forward Citations

Loading…