The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 19, 2018

Filed:

Feb. 10, 2017
Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Rahil Garnavi, Macleod, AU;

Dwarikanath Mahapatra, Travancore, AU;

Suman Sedai, Melbourne, AU;

Ruwan B. Tennakoon, Hawthorn, AU;

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06K 9/62 (2006.01); G06K 9/46 (2006.01); G10L 15/26 (2006.01); G06F 19/00 (2018.01); G09B 23/28 (2006.01); G06N 3/04 (2006.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6254 (2013.01); G06F 19/321 (2013.01); G06K 9/00604 (2013.01); G06K 9/4604 (2013.01); G06K 9/6256 (2013.01); G06K 9/6263 (2013.01); G06N 3/0427 (2013.01); G06N 3/0445 (2013.01); G06N 3/08 (2013.01); G09B 23/28 (2013.01); G10L 15/265 (2013.01);
Abstract

A knowledge base is generated based on eye tracking, audio monitoring and image annotations, for determining image features from given images and sequences of image features to focus on in analyzing an image. An eye tracker monitors eye movements of a user analyzing an image and generates a sequence of eye movements. A user interface receives annotations on the image. Audio data received via a microphone is translated into text and keywords are extracted. The sequence of eye movements, the annotations and the keywords are correlated according to their time of occurrence. Image features are extracted from the image and mapped with the sequence of eye movements, the annotations and the keywords that are correlated. A recurrent neural network model is generated based on the mapped image features and predicts a likelihood of an expert image analyzer focusing on a feature in a given new image.


Find Patent Forward Citations

Loading…