Amazon Technologies, Inc.

Mark Robinson

Marc Stephen Olson

Christopher Magee Greenwood

Mitchell Gannon Flaherty

Sriram Venugopal

Colin Williams

Kristina Kraemer Brenneman

Valentin-Gabriel Priescu

Linlin Ding

Peter B Nigh

Mahesh Sreekandath

Sonal Agarwal

Farhan Tanvir Ali

Gautham Narayanasamy

Systems and methods are provided for providing a consistent experience for users of cloud-based block storage volumes. While cloud storage aims to remove hardware considerations for an end user's experience, block storage performance can nevertheless vary according to the underlying hardware used to support a volume or the specific network location of that hardware. Embodiments of the present disclosure address that inconsistent performance by associating a volume with a performance profile that sets a target latency for the volume. A storage client can then monitor observed latency for the volume and inject synthetic latency into input/output operations for the volume as calculated via a proportional-integral-derivative algorithm, such that the observed latency matches the target within the performance profile. This enables the cloud provider to vary physical hardware or network configurations without effect on block storage performance from the point of view of an end user.

Providing consistent performance of block-storage volumes in cloud computing environments

A block storage service analyzes customer behaviors as external signals to the health of the block storage service. In one example, using rules set by a customer for a health monitoring service, the block storage service can gain insights into what the customer cares about. The customer rules can then be used to setup internal monitors within the block storage service. If the internal monitors are triggered, the block storage service can proactively correct problems before the customer alarm thresholds are reached. For example, customer volumes can be moved to increase performance characteristics. In some cases, if the customer has too much performance capability, the customer volume can be moved to a less costly alternative.

Using customer input to determine proper functionality of a block storage service

Systems and methods are provided for providing a consistent experience for users of cloud-based block storage volumes. While cloud storage aims to remove hardware considerations for an end user's experience, block storage performance can nevertheless vary according to hardware configuration, such as the specific model of underlying hardware used to support a volume or the specific network location of that hardware. Embodiments of the present disclosure address that inconsistent performance by associating a volume with a performance profile, which can represent a desired distribution of performance for the volume. Each read or write can be compared to the profile, and may be selectively delayed to match the desired performance. This enables the cloud provider to vary physical hardware or network configurations without effect on block storage performance from the point of view of an end user.

Delaying result of I/O operation based on target completion time

Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica pool of the data volume, include a number of replicas duplicating data of the data volume. By providing increased parallelization, the replica pool can facilitate rapid duplication of the volume. In one configuration, each partition of a new volume is mapped to an individual replica within the replica pool, which supports population of the partition with data. Each replica can further include a set of replica partitions, such that read requests from each partition of a new volume are distributed among a number of servers to provide additional parallelization.

Replica pools to support volume replication in distributed storage systems

Growing community of inventors

Seattle, WA, United States of America

Mark Robinson