Amazon Technologies, Inc.

Phillip Segel

Michael Leo Weiss

Carlos Alejandro Arguelles

Ryan Preston Gantt

Brian Thomas Kachmarck

Aman Ahmed

Ramakanthachary S Gottumukkala

Aravindhan Vijayaraghavan

Nalledath P Vinodkrishnan

Paul Connell

Aravindhan Rathakrishnan

Saravana Prasad Stalin

Praveen Kumar Udayakumar

Mateusz Haligowski

Pablo Alberto De Stefani Casanova

Nader Ali Syed Shirazie

Changhai Yuan

Branden Nicholas Vandermoon

Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.

Non-blocking concurrent work in a transaction generator

Techniques for determining the ability of a modified set of processes to process requests received by an initial set of processes include dividing the requests received by the initial processes into subsets. Each subset includes requests having common values for a set of request parameters. Test data is generated that includes at least one request from each subset. The test data is processed by the modified processes to determine responses. If the response for a request that is determined by the modified processes corresponds to the response for that request that was determined by the initial processes, this correspondence indicates that the modified processes may generate a proper response for each request included in the same subset as the tested request. As a result, the ability of the modified processes to replace the initial processes may be tested using only a portion of the requests received by the initial processes.

System for testing impact of code modifications

This disclosure describes methods, apparatuses, and systems for providing visualizations of workflows. Data associated with successes and failures of individual components of workflows can be collected and aggregated to provide an overview of the operation of workflows, as well as allowing a software developer to troubleshoot operations of the workflow. Status indications of steps can be visualized in a graphical user interface (GUI), for example, and faults can be identified and presented in the GUI. By aggregating workflow data across hundreds, thousands, or even millions of workflows, a user can quickly determine the overall operations of the workflow, as well as areas of the workflow that may need improvement.

Process visualization platform

Tracking work in an asynchronous application or service during load testing

Techniques described herein provide for real-time observation of utilization of one or more resources by a system in response to an input. The real-time observation by a system may occur in an environment in which end users supply inputs to the system (e.g., a production environment). In various embodiments, a server system may provide a service to a client system. A client system may take advantage of this service by sending an input to the server system. In response, the server system may perform the provisioned service using the input from the client system. In connection with the service, the utilization of resources (e.g., by a process) and/or the client system-supplied input may be recorded, such as when resources are utilized in an unexpected or interesting manner. These records may be used at a later time for testing and analysis.

Code coverage and data analysis

Growing community of inventors

Auburn, WA, United States of America

Phillip Segel