Amazon Technologies, Inc.

Colin Williams

Christopher Magee Greenwood

Danny Wei

Kiran-Kumar Muniswamy-Reddy

Igor A Kostic

Wells Lin

Pavel Labovich

Kristina Kraemer Brenneman

Mark Robinson

Ashritha Nagavaram

Sonal Agarwal

Gautham Narayanasamy

Linlin Ding

Nathan William Sharp

Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked elastic computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.

Rapid volume backup generation from distributed replica

A snapshot object or other type of object may be stored in a first storage system and may be accelerated in another storage system, wherein an accelerated snapshot or other type of object can be used to populate volumes in the other storage system with data more rapidly than a non-accelerated snapshot or other type of object. The accelerated snapshot or other object may be implemented using an intermediate volume implemented in the other storage system that is populated with data from the snapshot object or the other object stored in the first storage system.

Accelerated volumes

Techniques for selecting a network communications protocol based on network topology and/or network performance are described. A first application executing on a first computer system obtains a distance characteristic of a network coupling the first computer system to a second computer system. The first application selects a network communications protocol from a plurality of network communications protocols based on the distance characteristic of the network. The first application and the second application connect with the selected network communications protocol. In some embodiments, the distance characteristic of the network may be based on topological or performance characteristics of the network.

Network communications protocol selection based on network topology or performance

Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica of the data volume, designated for duplication of data within the volume and separate from one or more other replicas designated for handling modifications to the data volume. By providing increased parallelization, the highly distributed replica can facilitate rapid duplication of the volume. When a sufficiently large request to duplicate the data volume is received, the system can create additional duplicate portions of the volume to further increase parallelization. For example, a partition of the highly distributed replica may be repeatedly duplicated to create a large number of intermediary duplicate partitions. The intermediary duplicate partitions can then be used to service the duplication request rapidly, due to increased parallelism.

Intermediary duplication to facilitate copy requests in distributed storage systems

Generally described, aspects of the present application correspond to enabling rapid duplication of data within a data volume hosted on a network storage system. The network storage system can maintain a highly distributed replica pool of the data volume, include a number of replicas duplicating data of the data volume. By providing increased parallelization, the replica pool can facilitate rapid duplication of the volume. In one configuration, each partition of a new volume is mapped to an individual replica within the replica pool, which supports population of the partition with data. Each replica can further include a set of replica partitions, such that read requests from each partition of a new volume are distributed among a number of servers to provide additional parallelization.

Replica pools to support volume replication in distributed storage systems

Generally described, one or more aspects of the present application correspond to techniques for new block store volumes of data from object storage snapshots of an origin volume by creating an intermediary 'acceleration pool' of source volumes reserved for supporting the new volume creation process. The source volumes may be prevented from supporting user I/O or computing instances in order to reserve their bandwidth for the transfer of data to the new volumes. In addition, the source volumes can be stored on block store servers to increase the speed with which their data can be transferred to the new volumes. The acceleration pool can be partitioned among users accessing the pool in order to maintain availability even when some users heavily utilize the acceleration pool, with particular source volumes intelligently selected from among a user's partition in order to optimize the speed at which the new volumes are created.

Dedicated source volume pool for accelerated creation of block data volumes from object data snapshots

Selection from dedicated source volume pool for accelerated creation of block data volumes

Generally described, one or more aspects of the present application correspond to a highly distributed replica of a volume stored in a networked computing environment. First and second replicas of the volume can be synchronously replicated, and some implementations of the tertiary replica can be asynchronously replicated. The highly distributed nature of the tertiary replica supports parallel data transfer of the data of the volume, resulting in faster creation of backups and new copies of the volume.

Growing community of inventors

Seattle, WA, United States of America

Colin Williams