Adobe, Inc.

Jaemin Cho

Franck Dernoncourt

Ajinkya Gorakhnath Kale

Trung Huu Bui

Seunghyun Yoon

Systems and methods for image captioning are described. One or more aspects of the systems and methods include generating a training caption for a training image using an image captioning network; encoding the training caption using a multi-modal encoder to obtain an encoded training caption; encoding the training image using the multi-modal encoder to obtain an encoded training image; computing a reward function based on the encoded training caption and the encoded training image; and updating parameters of the image captioning network based on the reward function.

Growing community of inventors

Chapel Hill, NC, United States of America

Jaemin Cho