The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Mar. 16, 2021

Filed:

Jul. 10, 2019
Applicant:

Adobe Inc., San Jose, CA (US);

Inventors:

Zhe Lin, Fremont, CA (US);

Yufei Wang, La Jolla, CA (US);

Scott Cohen, Sunnyvale, CA (US);

Xiaohui Shen, San Jose, CA (US);

Assignee:

ADOBE INC., San Jose, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06N 3/08 (2006.01); G06F 16/58 (2019.01); G06K 9/46 (2006.01); G06K 9/62 (2006.01); G06N 3/04 (2006.01); G06F 40/205 (2020.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06F 16/5866 (2019.01); G06K 9/4628 (2013.01); G06K 9/6276 (2013.01); G06N 3/0445 (2013.01); G06N 3/0454 (2013.01); G06F 40/205 (2020.01);
Abstract

Provided are systems and techniques that provide an output phrase describing an image. An example method includes creating, with a convolutional neural network, feature maps describing image features in locations in the image. The method also includes providing a skeletal phrase for the image by processing the feature maps with a first long short-term memory (LSTM) neural network trained based on a first set of ground truth phrases which exclude attribute words. Then, attribute words are provided by processing the skeletal phrase and the feature maps with a second LSTM neural network trained based on a second set of ground truth phrases including words for attributes. Then, the method combines the skeletal phrase and the attribute words to form the output phrase.


Find Patent Forward Citations

Loading…