Sas Institute Inc.

Xin Jiang Hunt

Jorge Manuel Gomes Da Silva

Xinmin Wu

Ralph Walter Abbey

Ilknur Kaynar Kabul

Saba Emrani

Ricky Dee Tharrington, Jr

Amirhassan Fallah Dizche

Ye Liu

A computing device trains a fair prediction model while defining an optimal event cutoff value. (A) A prediction model is trained with observation vectors. (B) The prediction model is executed to define a predicted target variable value and a probability associated with an accuracy of the predicted target variable value. (C) A conditional moments matrix is computed based on fairness constraints, the predicted target variable value, and the sensitive attribute variable value of each observation vector. The predicted target variable value has a predefined target event value only when the probability is greater than a predefined event cutoff value. (D) (A) through (C) are repeated. (E) An updated value is computed for the predefined event cutoff value. (F) (A) through (E) are repeated. An optimal event cutoff value is defined from the predefined event cutoff values used when repeating (A) through (E). The optimal value and prediction model are output.

Cutoff value optimization for bias mitigating machine learning training system with multi-class target

A computing device trains a fair machine learning model. A predicted target variable is defined using a trained prediction model. The prediction model is trained with weighted observation vectors. The predicted target variable is updated using the prediction model trained with weighted observation vectors. A true conditional moments matrix and a false conditional moments matrix are computed. The training and updating with weighted observation vectors are repeated until a number of iterations is performed. When a computed conditional moments matrix indicates to adjust a bound value, the bound value is updated based on an upper bound value or a lower bound value, and the repeated training and updating with weighted observation vectors is repeated with the bound value replaced with the updated bound value until the conditional moments matrix indicates no further adjustment of the bound value is needed. A fair prediction model is trained with the updated bound value.

Bias mitigating machine learning training system

A computing device trains a fair machine learning model. A prediction model is trained to predict a target value. For a number of iterations, a weight vector is computed using the bound value based on fairness constraints defined for a fairness measure type; a weight value is assigned to each observation vector based on the target value and a sensitive attribute value; the prediction model is trained with each weighted observation vector to predict the target value; and a conditional moments vector is computed based on the fairness constraints and the target and sensitive attribute values. Conditional moments difference values are computed. When the conditional moments difference values indicate to adjust the bound value, the bound value is updated and the process is repeated with the bound value replaced with the updated bound value until the conditional moments difference values indicate no further adjustment of the bound value is needed.

A computing device generates synthetic tabular data. Until a convergence parameter value indicates that training of an attention generator model is complete, conditional vectors are defined; latent vectors are generated using a predefined noise distribution function; a forward propagation of an attention generator model that includes an attention model integrated with a conditional generator model is executed to generate output vectors; transformed observation vectors are selected; a forward propagation of a discriminator model is executed with the transformed observation vectors, the conditional vectors, and the output vectors to predict whether each transformed observation vector and each output vector is real or fake; a discriminator model loss value is computed based on the predictions; the discriminator model is updated using the discriminator model loss value; an attention generator model loss value is computed based on the predictions; and the attention generator model is updated using the attention generator model loss value.

Tabular data generation with attention for machine learning model training system

A computing device computes a weight matrix to compute a predicted value. For each of a plurality of related tasks, an augmented observation matrix, a plug-in autocovariance matrix, and a plug-in covariance vector are computed. A weight matrix used to predict the characteristic for each of a plurality of variables and each of a plurality of related tasks is computed. (a) and (b) are repeated with the computed updated weight matrix as the computed weight matrix until a convergence criterion is satisfied: (a) a gradient descent matrix is computed using the computed plug-in autocovariance matrix, the computed plug-in covariance vector, the computed weight matrix, and a predefined relationship matrix, wherein the predefined relationship matrix defines a relationship between the plurality of related tasks, and (b) an updated weight matrix is computed using the computed gradient descent matrix.

Analytic system based on multiple task learning with incomplete data

Systems and methods for machine learning, models, and related explainability and interpretability are provided. A computing device determines a contribution of a feature to a predicted value. A feature computation dataset is defined based on a selected next selection vector. A prediction value is computed for each observation vector included in the feature computation dataset using a trained predictive model. An expected value is computed for the selected next selection vector based on the prediction values. The feature computation dataset is at least a partial copy of a training dataset with each variable value replaced in each observation vector included in the feature computation dataset based on the selected next selection vector. Each replaced variable value is replaced with a value included in a predefined query for a respective variable. A Shapley estimate value is computed for each variable.

Machine learning model feature contribution analytic system

A computing device computes a weight matrix to predict a value for a characteristic in a scoring dataset. For each of a plurality of related tasks, an augmented observation matrix, a plug-in autocovariance matrix, and a plug-in covariance vector are computed. A weight matrix used to predict the characteristic for each of a plurality of variables and each of a plurality of related tasks is computed. (a) and (b) are repeated with the computed updated weight matrix as the computed weight matrix until a convergence criterion is satisfied: (a) a gradient descent matrix is computed using the computed plug-in autocovariance matrix, the computed plug-in covariance vector, the computed weight matrix, and a predefined relationship matrix, wherein the predefined relationship matrix defines a relationship between the plurality of related tasks, and (b) an updated weight matrix is computed using the computed gradient descent matrix.

Growing community of inventors

Cary, NC, United States of America

Xin Jiang Hunt