The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 22, 2023

Filed:

Apr. 10, 2020
Applicant:

International Business Machines Corporation, Armonk, NY (US);

Inventors:

Orna Raz, Haifa, IL;

Eitan Farchi, Pardes Hana, IL;

Marcel Zalmanovici, Kiriat Motzkin, IL;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 11/34 (2006.01); G06N 20/00 (2019.01); G06V 10/44 (2022.01); G06V 10/82 (2022.01); G06F 18/214 (2023.01); G06V 10/764 (2022.01);
U.S. Cl.
CPC ...
G06F 11/3409 (2013.01); G06F 11/3495 (2013.01); G06F 18/214 (2023.01); G06N 20/00 (2019.01); G06V 10/457 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01);
Abstract

A method, apparatus and a product for determining a performance measurement of predictors. The method comprises obtaining a dataset comprising data instances. Each data instance is associated with a label; obtaining a predictor. The predictor is configured to provide a prediction of a label for a data instance; determining a plurality of data slices that are subsets of the dataset. computing, for each data slice in the plurality of data slices and based on an application of the predictor on each data instance that is mapped to the data slice, a performance measurement that is indicative of a successful label prediction for a data instance comprised by the data slice, whereby obtaining a plurality of performance measurements; based on the plurality of performance measurements, computing a performance measurement of the predictor over the dataset; if the performance measurement of the predictor is below a threshold, performing a mitigating action.


Find Patent Forward Citations

Loading…