The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 31, 2017

Filed:

Nov. 20, 2015
Applicant:

Microsoft Technology Licensing, Llc, Redmond, WA (US);

Inventors:

Tao Mei, Beijing, CN;

Ting Yao, Beijing, CN;

Yong Rui, Sammamish, WA (US);

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04N 5/445 (2011.01); H04N 21/8405 (2011.01); G06F 17/27 (2006.01); G06K 9/00 (2006.01); G06N 3/08 (2006.01);
U.S. Cl.
CPC ...
H04N 21/8405 (2013.01); G06F 17/274 (2013.01); G06F 17/2785 (2013.01); G06K 9/00718 (2013.01); G06N 3/08 (2013.01);
Abstract

Video description generation using neural network training based on relevance and coherence is described. In some examples, long short-term memory with visual-semantic embedding (LSTM-E) can maximize the probability of generating the next word given previous words and visual content and can create a visual-semantic embedding space for enforcing the relationship between the semantics of an entire sentence and visual content. LSTM-E can include a 2-D and/or 3-D deep convolutional neural networks for learning powerful video representation, a deep recurrent neural network for generating sentences, and a joint embedding model for exploring the relationships between visual content and sentence semantics.


Find Patent Forward Citations

Loading…