The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Apr. 07, 2026

Filed:

May. 08, 2023
Applicant:

Lemon Inc., Grand Cayman, KY;

Inventors:

Linjie Yang, Los Angeles, CA (US);

Heng Wang, Los Angeles, CA (US);

Yuhan Shen, Los Angeles, CA (US);

Longyin Wen, Los Angeles, CA (US);

Haichao Yu, Los Angeles, CA (US);

Assignee:

Lemon Inc., Grand Cayman, KY;

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
H04N 21/488 (2011.01); H04N 21/2389 (2011.01); H04N 21/84 (2011.01);
U.S. Cl.
CPC ...
H04N 21/4884 (2013.01); H04N 21/23892 (2013.01); H04N 21/84 (2013.01);
Abstract

A system and a method are provided that include a processor executing a caption generation program to receive an input video, sample video frames from the input video, extract video frames from the input video, extract video embeddings and audio embeddings from the video frames, including local video tokens and local audio tokens, respectively, input the local video tokens and the local audio tokens into at least a transformer layer of a cross-modal encoder to generate multi-modal embeddings, and generate video captions based on the multi-modal embeddings using a caption decoder.


Find Patent Forward Citations

Loading…