Amazon Technologies, Inc.

Ryan Preston Gantt

Brian Thomas Kachmarck

Carlos Alejandro Arguelles

Brian James Schuster

Jacob Carr

Avinash Shripathy Bhat

Michael Leo Weiss

Phillip Segel

Chen Zhou

Jazarine Jamal

Muhammad Usman

Kanika Kalra

Syed Sajid Nizami

Gracjan Polak

Amit Chhabra

Stanislav Pavlovskii

Chaiwat Shuetrakoonpaiboon

Ethan Fitzgerald John

Aman Ahmed

Asad Khan Durrani

Layer-specific modifications may be applied to a network communication received at a proxy according to configurable rules at the proxy. A modification configuration may be received at the proxy that corresponds to a layer of a communication stack supported by the proxy. When a communication is received, data from the layer of the communication stack of the network communication may be evaluated to determine whether a modification is applicable to the communication according to the modification configuration. An applicable modification may be applied by proxy as part of processing the communication at the proxy.

Layer-specific modifications to network communications according to configurable rules at a proxy

Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.

Non-blocking concurrent work in a transaction generator

A test system includes a controller that creates test jobs to simulate a load for testing a target system or service. The jobs specify test data from a data store. The controller adds the test jobs to a job queue at a rate. Workers access jobs from the job queue and request data from the data store as specified in each job and send the request data to the service. Approximations (e.g., metric values indicating performance of the worker host resources, or performance of the system under test or performance of resources that implement the system under test, other feedback, etc.) of actual system characteristics such as the actual number of workers are obtained. Based on the metric values, the controller modulates various characteristics of the load generation system, such as a rate at which jobs are added to the job queue or the number of workers processing jobs.

Control system for distributed load generation

Methods, systems, and computer-readable media for record-by-record live migration using segmentation are disclosed. Migration of a data set comprises, for a record in a segment being migrated, storing a first status indicating that the record is offline in a source data store. An instance of the record is stored in the destination data store, and a second status is stored to indicate that the record is online in the destination. The record is deleted from the source after the second status is stored. During the migration, a read request for the record is received and determined to be associated with the segment being migrated. A response to the read request is generated that comprises an authoritative instance of the record. The instance of the record in the destination is determined to represent the authoritative instance based (at least in part) on the first status and the second status.

Record-by-record live migration using segmentation

Methods, systems, and computer-readable media for segmentation of maintenance on distributed systems are disclosed. A data set is partitioned according to a hash function into a plurality of segments. A maintenance activity is initiated on a first segment. During the maintenance activity, a first request to perform a first action on the data set is received. Based at least in part on determining that the first request is associated with the first segment using the hash function, the first action is performed using additional processing associated with the maintenance activity. During the maintenance activity, a second request to perform a second action on the data set is received. Based at least in part on determining that the second request is associated with a second segment using the hash function, the second action is performed without the additional processing associated with the maintenance activity.

Segmentation of maintenance on distributed systems

Remote computing resource service providers, including online retailer, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and service inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. A coordinator may archive aggregated testing resources located on the isolated network and deploy the testing resources to the one or more external hosts. A database may be used to track the deployment state of the one or more external hosts in order to allow the coordinator to manage the testing process.

State-tracked testing across network boundaries

Tracking work in an asynchronous application or service during load testing

Remote computing resource service providers, including online retailers, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and services inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. As a result side effects may occur within the isolated network that is not accessible from the public network. The side effects may be recorded in a queue which may be accessed from inside the isolated network by one or more services. The one or more services may then reverse the side effects based at least in part on information contained in the queue.

Accessing resources across a network boundary

Growing community of inventors

Seattle, WA, United States of America

Ryan Preston Gantt