The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 07, 2022

Filed:

Nov. 22, 2021
Applicant:

Zhejiang Lab, Hangzhou, CN;

Inventors:

Hongsheng Wang, Hangzhou, CN;

Haijun Shan, Hangzhou, CN;

Shengjian Hu, Hangzhou, CN;

Assignee:

ZHEJIANG LAB, Hangzhou, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 40/20 (2020.01); G06K 9/62 (2022.01); G06N 20/00 (2019.01); G06N 5/04 (2006.01); G06N 5/02 (2006.01);
U.S. Cl.
CPC ...
G06F 40/20 (2020.01); G06K 9/6215 (2013.01); G06N 5/022 (2013.01); G06N 5/04 (2013.01); G06N 20/00 (2019.01);
Abstract

Disclosed is a meta-knowledge fine tuning method and platform for a multi-task language model. The method is to obtain highly transferable shared knowledge, that is, meta-knowledge, on different data sets of tasks of the same category, perform interrelation and mutual reinforcement on the learning processes of the tasks of the same category that correspond to different data sets and are in different domains, so as to improve the fine tuning effect of downstream tasks of the same category on data sets of different domains in the application of the language model, and improve the parameter initialization ability and the generalization ability of a general language model for the tasks of the same category.


Find Patent Forward Citations

Wang, Hongsheng. (2022). Meta-knowledge fine tuning method and platform for multi-task language model (U.S. Patent No. 11354499). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/11354499

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…