The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 31, 2021
Filed:
Jan. 29, 2018
Peking University Shenzhen Graduate School, Shenzhen, CN;
Wenmin Wang, Shenzhen, CN;
Lu Ran, Shenzhen, CN;
Ronggang Wang, Shenzhen, CN;
Ge Li, Shenzhen, CN;
Shengfu Dong, Shenzhen, CN;
Zhenyu Wang, Shenzhen, CN;
Ying Li, Shenzhen, CN;
Hui Zhao, Shenzhen, CN;
Wen Gao, Shenzhen, CN;
Peking University Shenzhen Graduate Sohool, Shenzhen, CN;
Abstract
A bidirectional image-text retrieval method based on a multi-view joint embedding space includes: performing retrieval with reference to a semantic association relationship at a global level and a local level, obtaining the semantic association relationship at the global level and the local level in a frame-sentence view and a region-phrase view, and obtaining semantic association information in a global level subspace of frame and sentence in the frame-sentence view, obtaining semantic association information in a local level subspace of region and phrase in the region-phrase view, processing data by a dual-branch neural network in the two views to obtain an isomorphic feature and embedding the same in a common space, and using a constraint condition to reserve an original semantic relationship of the data during training, and merging the two semantic association relationships using multi-view merging and sorting to obtain a more accurate semantic similarity between data.