Rejecting biased data using a machine learning model

Abstract

A method for rejecting biased data includes receiving a bias training data set based on a probability distribution of bias-sensitive variables of a target population and segmenting the bias training data set into clusters based on at least one respective bias-sensitive variable of the target population, each cluster including a bias cluster weight. The method also includes receiving a training data set for a machine learning model and segmenting the training data set into training clusters. Each training cluster is associated with at least one corresponding bias-sensitive variable of the target population and includes a corresponding training data set weight. The method also includes adjusting each training data set weight to match a respective bias cluster weight to form an adjusted training data set and providing the adjusted training data set to the machine learning model as an unbiased training data set.