Mechanisms for scaling extract transform load code generation

Abstract

Systems and methods for graph-based Extract Transform Load (ETL) code generation are disclosed. A natural language request to create ETL code according to a description of the ETL code in the natural language request may be received. A graph representation of the ETL code may be generated that includes nodes corresponding to operations to obtain data from data sources, perform transformations to at least the portion of the data, and store the data in destinations. To create the graph representation, interactions with a generative machine learning model may identify the operations for the ETL code in the description in the natural language request and construct the graph representation that includes the nodes corresponding to the operations along with connections between the nodes identified according to the description in the natural language request. A response to the natural language request may be provided via the interface based on the graph representation.