Automatical generation and maintenance of data cards for datasets

Abstract

In various examples, techniques for automatically generating and maintaining data cards for datasets is described herein. Systems and methods are disclosed that process a dataset in order to identify relevant information associated with the dataset. For example, the dataset may include and/or be associated with sources of information—such as files, documents, links, memos, research papers, annotations, labels, and/or the like—that describe data instances (e.g., images, audio clips, point clouds, etc.) included in the dataset. These sources of information may then be analyzed to retrieve the relevant information associated with the dataset. Systems and methods are then further disclosed that may use one or more language models to process input data associated with the relevant information in order to generate a data card associated with the dataset.