The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 12, 2024
Filed:
May. 13, 2021
Beijing Baidu Netcom Science and Technology Co., Ltd., Beijing, CN;
Fei Yu, Beijing, CN;
Jiji Tang, Beijing, CN;
Weichong Yin, Beijing, CN;
Yu Sun, Beijing, CN;
Hao Tian, Beijing, CN;
Hua Wu, Beijing, CN;
Haifeng Wang, Beijing, CN;
BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD., Beijing, CN;
Abstract
A multi-modal pre-training model acquisition method, an electronic device and a storage medium, which relate to the fields of deep learning and natural language processing, are disclosed. The method may include: determining, for each image-text pair as training data, to-be-processed fine-grained semantic word in the text; masking the to-be-processed fine-grained semantic words; and training the multi-modal pre-training model using the training data with the fine-grained semantic words masked.