Snowflake Inc.

Kushan A Zaveri

Srinath Shankar

Harsha S Kapre

Mark T Keller

Techniques for fetching query result data using result batches includes retrieving query result information from a first computing node of a database system. The query result information includes result data associated with a multi-stage execution of a query. A plurality of result batches are generated based on the query result information. Each result batch of the plurality of result batches includes a retrieval function for a portion of the result data. The portion of the result data for each result batch of the plurality of result batches is retrieved based on execution of the retrieval function by at least a second computing node of the database system. The result data associated with the multi-stage execution of the query is output based on completion of the retrieval.

Fetching query result data using result batches

Techniques for configuring query result information include decoding a query received from a client device of a network-based database system. A multi-stage execution of the query is configured to obtain a plurality of query result subsets. A combined query result is generated using the plurality of query result subsets. The combined query result further includes storage location information for each of the plurality of query result subsets. The combined query result is encoded for transmission to the client device in response to the query.

Configuring query result information based on multi-stage query execution

Techniques for fetching query result data using result batches includes generating a plurality of result batches based on query result information. The query result information is associated with query result data generated from execution of a query. Each result batch of the plurality of result batches includes a result data retrieval function for a corresponding data portion of a plurality of data portions of the query result data. The plurality of result batches are encoded for distribution to a corresponding plurality of computing nodes. The techniques further include causing retrieving of the plurality of data portions of the query result data by the corresponding plurality of computing nodes based on the result data retrieval function for each of the plurality of data portions.

Techniques for configuring query result information associated with query result data include configuring execution of a query using a plurality of execution stages. Query result data is generated based on the execution of the query. The query result data includes a plurality of data portions. Each data portion of the plurality of data portions is obtained at a corresponding execution stage of the plurality of execution stages. Query result information is generated based on the execution of the query. The query result information includes authentication information associated with accessing the plurality of data portions.

Configuring query result information for result data obtained at multiple execution stages

Provided herein are systems and methods for query result data processing, including parallel fetching and processing of query result data. A system includes at least one hardware processor coupled to memory and configured to obtain query result information associated with query result data. Multiple result batches are generated based on the query result information. Each result batch of the multiple result batches includes location information and schema information associated with a portion of the query result data. A data processing request corresponding to the result batch is detected. The portion of the query result data associated with the result batch is retrieved in response to the data processing request. The retrieving uses the location information within the result batch. The portion of the query result data is parsed using the schema information, to generate parsed result data.

Parallel fetching of query result data

Provided herein are systems and methods for query result data processing, including parallel fetching and processing of query result data. A system includes at least one hardware processor coupled to memory and configured to execute a query received from a first computing device, to obtain query result data. The at least one hardware processor is further configured to store the query result data at a storage location. The at least one hardware processor is further configured to generate query result information associated with the query result data. The query result information includes location information associated with the storage location and schema information associated with the query result data. The at least one hardware processor is further configured to encode the query result information for transmission to the first computing device.

Growing community of inventors

North York, Canada

Kushan A Zaveri