The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 07, 2017

Filed:

Jan. 13, 2016
Applicant:

Adobe Systems Incorporated, San Jose, CA (US);

Inventors:

Zhaowen Wang, San Jose, CA (US);

Quanzeng You, Rochester, NY (US);

Hailin Jin, San Jose, CA (US);

Chen Fang, Santa Clara, CA (US);

Assignee:

Adobe Systems Incorporated, San Jose, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/68 (2006.01); G06K 9/62 (2006.01); G06K 9/46 (2006.01); G06F 17/30 (2006.01); G06N 3/08 (2006.01); G06N 3/04 (2006.01); G06N 7/00 (2006.01);
U.S. Cl.
CPC ...
G06K 9/6269 (2013.01); G06F 17/3028 (2013.01); G06F 17/30675 (2013.01); G06K 9/4604 (2013.01); G06K 9/6202 (2013.01); G06N 3/0445 (2013.01); G06N 3/08 (2013.01); G06N 7/005 (2013.01);
Abstract

Techniques for image captioning with weak supervision are described herein. In implementations, weak supervision data regarding a target image is obtained and utilized to provide detail information that supplements global image concepts derived for image captioning. Weak supervision data refers to noisy data that is not closely curated and may include errors. Given a target image, weak supervision data for visually similar images may be collected from sources of weakly annotated images, such as online social networks. Generally, images posted online include 'weak' annotations in the form of tags, titles, labels, and short descriptions added by users. Weak supervision data for the target image is generated by extracting keywords for visually similar images discovered in the different sources. The keywords included in the weak supervision data are then employed to modulate weights applied for probabilistic classifications during image captioning analysis.


Find Patent Forward Citations

Loading…