The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 31, 2024
Filed:
Jan. 26, 2021
International Business Machines Corporation, Armonk, NY (US);
Yunfeng Zhang, Chappaqua, NY (US);
Qingzi Liao, White Plains, NY (US);
Bhavya Ghai, Stony Brook, NY (US);
Klaus Mueller, New York, NY (US);
INTERNATIONAL BUSINESS MACHINES CORPORATION, Armonk, NY (US);
Abstract
A method optimizes machine learning systems. A computing device accesses a committee of classifiers that have been trained using an initial labeled instance of data from an annotator. The initial labeled instance of data includes annotator-ranked attributes of the data, initial values of the attributes, and an initial prediction label that describes an initial predicted state based on the values. The computing system compares the attributes ranking from the annotator to attributes rankings that are generated by and used by each of the machine learning systems when evaluating one or more instances of unlabeled data that include the attributes, and weights the machine learning systems according to how closely each of the attributes rankings generated by and used by each of the machine learning systems match the attributes ranking from the annotator. The machine learning systems are then optimized based on this matching.