Discover Financial Services LLC

Capital One Financial Corporation

Konstandinos Kotsiopoulos

Arjun Ravi Kannan

Alexey Miroshnikov

Raghu Kulkarni

Steven Dickerson

Ryan Franks

A computing platform is configured to (i) train a data science model object to receive an input data record including a set of input variables and output a score for the input data record, (ii) arrange the set of input variables into variable groups based on dependencies between input variables, (iii) identify an input data record to be scored by the model object, (iv) for each respective variable group, iterate the following: (a) identify a sample historical data record from a set of historical data records, (b) select a random group coalition including the respective variable group and zero or more other variable groups, and (c) use the input data record, the sample historical data record, and the randomly-selected group coalition to compute an iteration-specific contribution value, and (v) for each respective variable group, aggregate the iteration-specific contribution values for each iteration and thereby determine an aggregated contribution value for the respective variable group.

Computing system and method for applying monte carlo estimation to determine the contribution of dependent input variable groups on the output of a data science model

A computing platform may be configured to (i) train an initial model object for a data science model using a machine learning process, (ii) determine that the initial model object exhibits a threshold level of bias, and (iii) thereafter produce an updated version of the initial model object having mitigated bias by (a) identifying a subset of the initial model object's set of input variables that are to be replaced by transformations, (b) producing a post-processed model object by replacing each respective input variable in the identified subset with a respective transformation of the respective input variable that has one or more unknown parameters, (c) producing a parameterized family of the post-processed model object, and (d) selecting, from the parameterized family of the post-processed model object, one given version of the post-processed model object to use as the updated version of the initial model object for the data science model.

Computing system and method for creating a data science model having reduced bias

A framework for interpreting machine learning models is proposed that utilizes interpretability methods to determine the contribution of groups of input variables to the output of the model. Input variables are grouped based on dependencies with other input variables. The groups are identified by processing a training data set with a clustering algorithm. Once the groups of input variables are defined, scores related to each group of input variables for a given instance of the input vector processed by the model are calculated according to one or more algorithms. The algorithms can utilize group Partial Dependence Plot (PDP) values, Shapley Additive Explanations (SHAP) values, and Banzhaf values, and their extensions among others, and a score for each group can be calculated for a given instance of an input vector per group. These scores can then be sorted, ranked, and then combined into one hybrid ranking.

System and method for utilizing grouped partial dependence plots and game-theoretic concepts and their extensions in the generation of adverse action reason codes

A framework for interpreting machine learning models is proposed that utilizes interpretability methods to determine the contribution of groups of input variables to the output of the model. Input variables are grouped based on correlation with other input variables. The groups are identified by processing a training data set with a clustering algorithm. Once the groups of input variables are defined, partial dependent plot (PDP) tables for each group are calculated and stored in a memory, which are used for calculating scores related to each group of input variables for a given instance of the input vector processed by the model. Furthermore, Shapley Additive Explanations (SHAP) values for each group can be calculated by summing the SHAP values of the input variables for a given instance of an input vector per group. These scores can then be sorted, ranked for each interpretability method, and then combined into one hybrid ranking.

System and method for utilizing grouped partial dependence plots and shapley additive explanations in the generation of adverse action reason codes

A method, system, and computer-readable medium are disclosed for detecting and mitigating bias in a trained machine learning model. The method includes the steps of: training the model based on a training data set; detecting bias in the model relative to a protected class; identifying one or more groups of input variables that contribute to the bias; and mitigating bias in the model. Mitigating the bias is performed by constructing a post-processed score function that either (a) neutralizes or partially neutralizes one or more groups of input variables in the input vector of the model, or (b) utilizes a fair score approximation of the model to project the distributions for the protected class and/or the unprotected class to substantially match. In an embodiment, detecting bias in the trained model is performed by comparing distribution for two or more subpopulations based on a distance metric, such as a Wasserstein distance.

Growing community of inventors

Easthampton, MA, United States of America

Konstandinos Kotsiopoulos