Amazon Technologies, Inc.

Jian Fang

Rahul Sharma Pathak

Xing Wu

Abhishek Rajnikant Sinha

Jason Douglas Denton

Turkay Mert Hocanin

Bhargava Ram Kalathuru

Luca Natali

Yuanyuan Yue

Pratik Bhagwat Gawande

Sumeetkumar Veniklal Maru

Armen Tangamyan

Yufeng Jiang

Andrew Edward Caldwell

Marc Howard Beitchman

Mehul A Shah

George Steven McPherson

Anthony A Virtuoso

Ankit Kamboj

Rahul Pathak

Dag Stockstad

Akila Tennakoon

Seth Thomas Denney

Jason Denton

Queries may be received and executed by a managed query service. A query directed to data sets that are separately stored in a remote data store may be received. Computing resources to execute the query may be provisioned from a pool of computing resources that are configured to execute queries. The query may be routed to the provisioned computing resources to execute the query. Results may be obtained from the computing resource and provided to a submitter of the query.

Managed query service

Query execution status may be tracked to selectively route queries to resources for execution. The completion of queries executing at computing resources obtained from a pool of computing resources configured to execute queries may be detected. Instead of returning the computing resources to the pool, the computing resources may be identified as available in resource management data. When another query is received, the resource management data may be evaluated to select an available computing resource. The query may then be routed to the selected computing resource for execution.

Tracking query execution status for selectively routing queries

Techniques are described for an interactive query service that enables users to query data stored at a federated collection of data sources. An interactive query service provides interfaces that enable users to configure the interactive query service to query any number of heterogeneous data sources pertinent to a user. In general, the configuration of a data source can include identification of: a data source type, access configurations related to accessing the data source, and in some cases metadata describing a structure of the data stored by the data source (for example, a data catalog describing schemas, tables, columns, partitions, datatypes, or other metadata associated with the stored data). Once configured, an interactive query service can receive and execute queries that involve data stored at any combination of a user's data sources, where the queries may be expressed using a standard query language such as the Structured Query Language (SQL).

Enabling federated query access to Heterogeneous data sources

The configuration of computing resources for executing queries may be selected. A comparison of the configuration of computing resources that executed previous queries may be made to select the configuration of computing resources for a received query. A historical query execution model maybe applied, in some embodiments, to determine a resource configuration for computing resources to execute a query. The computing resources may be selected from available computing resources according to the determined resource configuration.

Selecting resource configurations for query execution

A system adapted to process long-running processes is disclosed. A request to upload data is received at a server. The server divides the data into multiple parts and launches a separate process to upload each of the divided parts. The server records for each process the processing time or duration that the particular process used to upload its corresponding data item. The server maintains an average processing duration that is calculated from the processing durations of the completed processes. The server identifies that one process is continuing to run and compares a processing duration for the particular process to a threshold derived from the average processing duration. If the processing duration for the particular process exceeds the threshold, the server initiates a new process to upload the same data item. When one of either the new process or the still running process has completed processing, the server terminates the other process.

Processing of long running processes

Growing community of inventors

Sammamish, WA, United States of America

Jian Fang