The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 23, 2022
Filed:
Jan. 15, 2020
Beijing Jingdong Shangke Information Technology Co., Ltd., Beijing, CN;
Jd.com American Technologies Corporation, Mountain View, CA (US);
Shizhu Liu, Mountain View, CA (US);
Yang Tao, Seattle, WA (US);
Shanglin Yang, Sunnyvale, CA (US);
Li Chen, Mountain View, CA (US);
Hui Zhou, Sunnyvale, CA (US);
BEIJING JINGDONG SHANGKE INFORMATION TECHNOLOGY CO., LTD., Beijing, CN;
JD.COM AMERICAN TECHNOLOGIES CORPORATION, Mountain View, CA (US);
Abstract
A system and a method for multimedia data analysis. The system includes a computing device. The computer device includes a processor and a storage device storing computer executable code. The computer executable code, when executed at the processor, is configured to: encode task description and task meta info into concatenated task vectors; encode context text and context meta info into concatenated context text vectors; encode context image and the context meta info into concatenated context image vectors; perform dual coattention on the concatenated task vectors and the concatenated context text and image vectors to obtain attended task vectors and attended context vectors; perform BiLSTM on the attended task vectors and the attended context vectors to obtain task encoding and context encoding; and decode the task encoding and the context encoding to obtain an answer to the task.