The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 23, 2019

Filed:

Nov. 22, 2017
Applicant:

Essential Products, Inc., Palo Alto, CA (US);

Inventors:

David John Evans, V, Palo Alto, CA (US);

Xinrui Jiang, San Jose, CA (US);

Andrew E. Rubin, Los Altos, CA (US);

Matthew Hershenson, Los Altos, CA (US);

Xiaoyu Miao, Palo Alto, CA (US);

Joseph Anthony Tate, San Jose, CA (US);

Jason Sean Gagne-Keats, Cupertino, CA (US);

Assignee:

ESSENTIAL PRODUCTS, INC., Palo Alto, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06T 7/62 (2017.01); G01N 21/01 (2006.01); G06N 20/00 (2019.01); G06T 5/00 (2006.01); G06T 5/50 (2006.01); G01N 21/15 (2006.01); G06N 3/02 (2006.01);
U.S. Cl.
CPC ...
G06T 7/62 (2017.01); G01N 21/01 (2013.01); G06N 20/00 (2019.01); G06T 5/002 (2013.01); G06T 5/005 (2013.01); G06T 5/50 (2013.01); G01N 2021/0137 (2013.01); G01N 2021/157 (2013.01); G06N 3/02 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01);
Abstract

In one embodiment, a light sensor, such as a camera, records an image through the surface with the residue to produce a stained image. A processor associated with the camera identifies object outlines within the image using a machine learning model, and smooth the colors within the object outlines. In another embodiment, the light sensor is placed beneath a dual-mode region of a display containing the residue. The dual-mode region can be opaque and function as part of the display, or can be transparent and allow environment light to reach the light sensor. Initially, the processor determines the position of the residue by causing the dual-mode region to display a predetermined pattern, while the light sensor records the predetermined pattern. Using the determined position of the residue, the processor corrects the pixels within the residue in the recorded image, by interpolating the values of the pixels outside of the residue.


Find Patent Forward Citations

Loading…