The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 17, 2022

Filed:

Mar. 31, 2020
Applicant:

Toyota Research Institute, Inc., Los Altos, CA (US);

Inventors:

Stephen G. McGill, Broomall, PA (US);

Guy Rosman, Newton, MA (US);

Simon Stent, Cambridge, MA (US);

Luke S. Fletcher, Cambridge, MA (US);

Deepak Edakkattil Gopinath, Chicago, IL (US);

Assignee:

TOYOTA RESEARCH INSTITUTE, INC., Los Altos, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06V 20/59 (2022.01); G06F 3/01 (2006.01); G06K 9/62 (2022.01); G06N 3/08 (2006.01); B60W 30/08 (2012.01); B60W 40/08 (2012.01); B60W 50/14 (2020.01); G05B 13/02 (2006.01); G06V 20/40 (2022.01);
U.S. Cl.
CPC ...
G06V 20/597 (2022.01); B60W 30/08 (2013.01); B60W 40/08 (2013.01); B60W 50/14 (2013.01); G05B 13/027 (2013.01); G06F 3/013 (2013.01); G06K 9/6262 (2013.01); G06N 3/08 (2013.01); G06V 20/46 (2022.01); B60W 2050/146 (2013.01); B60W 2420/42 (2013.01); B60W 2540/225 (2020.02);
Abstract

An embodiment takes the form of a training server that presents a video comprising a plurality of frames, each comprising a respective scene representation of a scene at a respective time. The scene representations comprise respective representations of a feature in the scene. The training server presents a respective gaze representation of a driver gaze for each frame. The gaze representations comprise respective representations of driver gaze locations at the times of the respective scene representations. The training server generates an awareness prediction via a neural network based on the driver gaze locations, the awareness prediction reflecting a predicted driver awareness of the feature. The training server receives an awareness indication associated with the video and the gaze representations, and trains the neural network based on a comparison of the awareness prediction with the awareness indication.


Find Patent Forward Citations

Loading…