The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 25, 2025

Filed:

Jan. 13, 2023
Applicant:

Jpmorgan Chase Bank, N.a., New York, NY (US);

Inventors:

Allan Anzagira, Long Island City, NY (US);

Freddy Lecue, Mamaroneck, NY (US);

Daniele Magazzeni, London, GB;

Saumitra Mishra, London, GB;

Assignee:

JPMORGAN CHASE BANK, N.A., New York, NY (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 21/56 (2013.01);
U.S. Cl.
CPC ...
G06F 21/56 (2013.01);
Abstract

Methods and systems for detecting attempted manipulation of a machine learning model via explanation poisoning are provided. The method includes: computing explanations based on outputs of the model that include information that relates to features that affect the output of the model with respect to the first data point; assigning labels to the explanations based on the features; generating an explanation ensemble that resides in an N-dimensional space, N being equal to a number of assigned labels plus one; determining a region within the N-dimensional space for which a subsequent introduction of data causes a subsequent explanation that does not relate to the features; and when the additional data is introduced to the determined region, generating an alert message for notifying a user that a likelihood of adverse manipulation of the model is high based on the additional data.


Find Patent Forward Citations

Loading…