Amazon Technologies, Inc.

Rajesh Sudhakar Sheth

Swaminathan Sivasubramanian

Grant Alexander Macdonald McAlister

Paul David Franklin

James Horsley

Grant A M McAlister

Leon Robert Warman

Narayan Gangadhar

Gokul Soundararajan

Grant Alexander Mcalister

Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an externally-facing interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using an externally-facing interface of the data environment, without accessing the control plane.

Control service for data management

The values of various operating and/or configuration parameters of a data environment are managed using a set of self-service Web services and interfaces of a separate control environment. A customer can submit a Web services call into an externally-facing application programming interface (API) or other such externally-facing interface of the control environment. The API receiving the call, as well as information extracted from the call, can be used to determine appropriate adjustments to be performed in the data environment. A workflow can be instantiated that includes tasks used to validate and/or apply the adjustments to the target resources, such as databases, data instances, data stores, instance classes, etc. Various real-time functions such as monitoring and auto-scaling also can be performed via the control plane.

Self-service configuration for data environment

System and methods for managing versions of partition maps in a distributed data store are disclosed. A relational database may use partition maps to indicate the location of data in a particular partition, or in a replica thereof. These partition maps may be versioned using a two-stage mechanism in which partition map updates are communicated to all nodes, or to affected nodes only, and in which operation may continue without waiting for acknowledgment of their application to each node. The system may handle minor partition changes differently than major partition changes. For example, if a replica of a partition is promoted to be a primary copy due to hardware or network failures, partition map changes may only be propagated to nodes in the same replica group. For major partition changes (e.g., splits, moves, mergers, added partitions, or size change), a new partition map may be made available to all nodes.

Versioning of database partition maps

Control service for relational data management

Administrative aspects of a data environment, such as the creation, deletion, and management of databases, are managed using a set of self-service Web services of a separate control environment. A user can submit a Web services call into an externally-facing interface of the control environment. The control environment can receive the call, extract information from the call, and determine appropriate actions to be performed in the data environment. A workflow can be instantiated that includes tasks used to perform the action in the data environment. Such an approach allows administrative aspects of the data environment to be managed through Web service calls to the control environment. Native access to databases in the data environment is provided using at least one externally-facing interface of the data environment, without accessing the control environment.

Self-service administration of a database

Aspects of a data environment, such as the creation, provisioning, and management of data stores and instances, are managed using a separate control environment. A user can call into an interface of the control environment, the call being analyzed to determine actions to be performed in the data environment. A monitoring component of the control plane also can periodically communicate with the data environment to determine any necessary actions to be performed, such as to recover from faults or events in the data environment. A workflow can be instantiated that includes tasks necessary to perform the action. For each task, state information can be passed to a component in the data environment operable to perform the task, until all tasks for an action are completed. Data in the data environment can be accessed directly using a separate interface of the data environment, without accessing the control plane.

Systems and methods for providing resource isolation in a shared computing environment using reinforcement learning (RL) techniques are disclosed. A resource isolation mechanism may be applied in a shared storage system, or database service, that limits the resource utilization of each namespace to its specified allocation. For example, the resource isolation mechanism may be used to limit the I/O utilization of database applications in a shared computing system (e.g., a system supporting a database service) to a specified limit. In such embodiments, RL techniques may be applied to the system to automatically control the rate of queries made by an application. RL techniques, such as those based on the State-Action-Reward-State-Action (SARSA) method may be effective in controlling the I/O utilization of database applications for different workloads. RL techniques may be applied globally by the service, or may be applied to particular subscribers, applications, shared resources, namespaces, or query types.

Resource isolation through reinforcement learning

System and methods for providing a Scalable Relational Database Service (SRDBS) are disclosed. SRDBS may allow a subscriber to lease/rent a virtual relational database (a.k.a. namespace) with a specified allocation of disk space, CPU resources and/or I/O resources. The namespace may resemble a physical RDBMS, and may allow client applications to perform SQL queries. SRDBS may partition a subscriber's database across multiple database servers automatically and may replicate each partition automatically. SRDBS may provide automatic routing of client queries to the appropriate database server holding the required data. The routing process may mask temporary data outages due to database replica failures, network failures, and/or repartitioning operations. SRDBS may employ partition maps to convey the location of data to client-side routing functions. These partition maps may use a multi-versioning scheme. SRDBS may provide a resource isolation mechanism that limits the resource utilization of each namespace to its specified allocation.

Scalable relational database service

Aspects of a target environment, such as the creation, deletion, and management of various resources, are managed using a set of self-service Web services of a separate control environment. A user can submit a Web services call into an externally-facing application programming interface (API) or other such externally-facing interface of the control environment. The API receiving the call, as well as information extracted from the call, can be used to determine appropriate actions to be performed in the target environment. A workflow can be instantiated that includes tasks used to perform the action in the target environment. Such an approach allows aspects of an environment to be managed through Web service calls to the control environment. Native access to resources in the target environment is provided using at least one externally-facing interface of the target environment, without accessing the control plane.

Growing community of inventors

Bellevue, WA, United States of America

Rajesh Sudhakar Sheth