Data set semantic similarity clustering

Abstract

Embodiments of the system in include a method of clustering data sets based on the data set characteristics. A data repository stores a plurality of heterogeneous data sets. For a selected group of data sets (i) obtaining metadata; (ii) identifying upstream data sets; and (iii) extracting semantic features. The method further comprises clustering the plurality of data sets into one or more clusters based on similarity, wherein the similarity is determined based on a combination of the metadata, the upstream data sets, and the semantic features of the selected data sets. In one embodiment, the data sets are ranked within each cluster based on data set quality. The method enables the presenting of at least one cluster including one or more ranked data sets in response to a search query.