Machine learning engine for determining data similarity

Abstract

System and methods for training and using a machine-learning similarity framework are provided. During training, the similarity framework generates an ensemble of tress. The trees have different properties at each node. The similarity framework uses the ensemble of trees to determine similarity between objects. The objects are propagated through nodes of each tree in the ensemble of trees until the objects reach leaf nodes. The objects are propagated by comparing the properties at each node of the tree to the features of the objects until the objects reach the leaf nodes. The similarity framework determines a similarity score for every two objects in each tree and adjusts the similarity score by tree importance. The object similarity score is determined by combining the similarity scores from the trees in the ensemble of trees. The similarity framework generates a similarity matrix with the object similarity scores of the every two objects.