The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 17, 2024
Filed:
Mar. 03, 2021
International Business Machines Corporation, Armonk, NY (US);
Abigail Goldsteen, Haifa, IL;
Ron Shmelkin, Haifa, IL;
International Business Machines Corporation, Armonk, NY (US);
Abstract
A method, computer system, and a computer program product for testing a data removal from a trained machine learning model trained with a training data set are provided. A new machine learning model is trained by using an altered data set that includes training data from the training data set. The altered data set is without removal data. A first forgetting mechanism is applied to the trained machine learning model to form a first revised machine learning model. The applying includes removing the removal data from the trained machine learning model. A first membership leakage quantification on the first revised machine learning model is performed to quantify a first membership leakage of the removal data and that uses the new machine learning model for comparison. A first leakage score is determined from the first membership leakage quantification to test the forgetting mechanism.