The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 28, 2025

Filed:

Nov. 18, 2021
Applicant:

Adobe Inc., San Jose, CA (US);

Inventors:

Jaemin Cho, Chapel Hill, NC (US);

Seunghyun Yoon, San Jose, CA (US);

Ajinkya Gorakhnath Kale, San Jose, CA (US);

Trung Huu Bui, San Jose, CA (US);

Franck Dernoncourt, San Jose, CA (US);

Assignee:

ADOBE INC., San Jose, CA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06F 40/253 (2020.01); G06F 16/583 (2019.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06K 9/62 (2022.01);
U.S. Cl.
CPC ...
G06F 40/253 (2020.01); G06F 16/583 (2019.01); G06F 18/214 (2023.01); G06F 18/217 (2023.01);
Abstract

Systems and methods for image captioning are described. One or more aspects of the systems and methods include generating a training caption for a training image using an image captioning network; encoding the training caption using a multi-modal encoder to obtain an encoded training caption; encoding the training image using the multi-modal encoder to obtain an encoded training image; computing a reward function based on the encoded training caption and the encoded training image; and updating parameters of the image captioning network based on the reward function.


Find Patent Forward Citations

Loading…