Maximizing generalizable performance by extraction of deep learned features while controlling for known variables

Abstract

Provided are systems and methods for the generation of machine-learning features by clustering deep learning embeddings and selecting embedding cluster data while controlling for known associations. In particular, a computing system can use a pre-trained machine learning model (e.g., an image embedding model) to obtain embeddings of input images. The computing system can train a clustering algorithm (e.g., a k-means algorithm) to cluster these embeddings into one of a number (e.g., k) clusters. The computing system can then perform a selection process to select one or more (e.g., the top n) clusters that boost performance in a prediction model (e.g., a logistic regression model) trained with a combination of the selected clusters and one or more baseline features. In such fashion, the computer system can enable an improved combination of extracted deep learned features and baseline features. This can maximize generalizable performance while controlling for known variables.