The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jan. 05, 2021

Filed:

Apr. 29, 2019
Applicant:

Tencent America Llc, Palo Alto, CA (US);

Inventor:

Boqing Gong, Bellevue, WA (US);

Assignee:

TENCENT AMERICA LLC, Palo Alto, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06K 9/00 (2006.01); G06N 20/00 (2019.01); G06N 3/08 (2006.01); G06K 9/62 (2006.01);
U.S. Cl.
CPC ...
G06K 9/00751 (2013.01); G06K 9/00718 (2013.01); G06K 9/6262 (2013.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01);
Abstract

A method of training a captioning model used to perform automatic video captioning of an input video, including initializing, by at least one processor, a plurality of long short-term memory (LSTM) units included in the captioning model using cross-entropy loss; training, by the at least one processor, the LSTM units using reinforcement learning; training, by the at least one processor, the LSTM units and a plurality of convolutional neural networks (CNNs) included in the captioning model using multitask training; and generating, by the at least one processor, a video caption corresponding to the input video using the captioning model.


Find Patent Forward Citations

Loading…