The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 22, 2021

Filed:

Oct. 12, 2018
Applicants:

Toyota Research Institute, Inc., Los Altos, CA (US);

Massachusetts Institute of Technology, Cambridge, MA (US);

Inventors:

Simon Stent, Cambridge, MA (US);

Adria Recasens, Cambridge, MA (US);

Antonio Torralba, Cambridge, MA (US);

Petr Kellnhofer, Cambridge, MA (US);

Wojciech Matusik, Cambridge, MA (US);

Assignee:

TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06T 7/292 (2017.01); G06F 3/01 (2006.01); G06T 7/246 (2017.01); G06N 3/08 (2006.01); H04N 5/247 (2006.01); G06N 5/04 (2006.01); H04N 5/232 (2006.01);
U.S. Cl.
CPC ...
G06T 7/292 (2017.01); G06F 3/013 (2013.01); G06N 3/084 (2013.01); G06N 5/046 (2013.01); G06T 7/246 (2017.01); H04N 5/23229 (2013.01); H04N 5/23293 (2013.01); H04N 5/247 (2013.01); G06T 2207/30196 (2013.01);
Abstract

A system for determining the gaze direction of a subject includes a camera, a computing device and a machine-readable instruction set. The camera is positioned in an environment to capture image data of head of a subject. The computing device is communicatively coupled to the camera and the computing device includes a processor and a non-transitory computer-readable memory. The machine-readable instruction set is stored in the non-transitory computer-readable memory and causes the computing device to: receive image data from the camera, analyze the image data using a convolutional neural network trained on an image dataset comprising images of a head of a subject captured from viewpoints distributed around up to 360-degrees of head yaw, and predict a gaze direction vector of the subject based upon a combination of head appearance and eye appearance image data from the image dataset.


Find Patent Forward Citations

Loading…