The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Dec. 28, 2021

Filed:

Dec. 17, 2019
Applicant:

Sri International, Menlo Park, CA (US);

Inventors:

Ajay Divakaran, Monmouth Junction, NJ (US);

Karan Sikka, Lawrenceville, NJ (US);

Karuna Ahuja, San Francisco, CA (US);

Anirban Roy, San Francisco, CA (US);

Assignee:

SRI International, Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/62 (2006.01); G06K 9/46 (2006.01); G06K 9/72 (2006.01); G06N 3/08 (2006.01); G06K 9/66 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6289 (2013.01); G06K 9/4609 (2013.01); G06K 9/629 (2013.01); G06K 9/66 (2013.01); G06K 9/726 (2013.01); G06N 3/08 (2013.01);
Abstract

A method, apparatus and system for understanding visual content includes determining at least one region proposal for an image, attending at least one symbol of the proposed image region, attending a portion of the proposed image region using information regarding the attended symbol, extracting appearance features of the attended portion of the proposed image region, fusing the appearance features of the attended image region and features of the attended symbol, projecting the fused features into a semantic embedding space having been trained using fused attended appearance features and attended symbol features of images having known descriptive messages, computing a similarity measure between the projected, fused features and fused attended appearance features and attended symbol features embedded in the semantic embedding space having at least one associated descriptive message and predicting a descriptive message for an image associated with the projected, fused features.


Find Patent Forward Citations

Loading…