The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 05, 2020

Filed:

Dec. 27, 2016
Applicant:

Adobe Inc., San Jose, CA (US);

Inventors:

Kan Chen, Los Angeles, CA (US);

Zhaowen Wang, San Jose, CA (US);

Trung Huu Bui, San Jose, CA (US);

Chen Fang, Sunnyvale, CA (US);

Assignee:

Adobe Inc., San Jose, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 16/53 (2019.01); G06F 16/58 (2019.01); G06F 16/583 (2019.01); G06N 3/04 (2006.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
G06F 16/5846 (2019.01); G06F 16/5838 (2019.01); G06F 16/5866 (2019.01); G06N 3/0454 (2013.01); G06N 3/08 (2013.01);
Abstract

Methods and systems are provided for ranking images against queries. A visual modality ranking of visual features of a digital image against a query is generated. A language modality ranking of text features of text associated with the digital image against the query is also generated. A multi-modal neural network determines importance weightings of the language modality ranking and the visual modality ranking against the query. The visual modality ranking and the language modality ranking are combined into a multi-modal ranking of the digital image against the query based on the importance weightings. The digital image is provided as a search result of the query based on the multi-modal ranking.


Find Patent Forward Citations

Loading…