Amazon Technologies, Inc.

Michael C Moore

Kyle Andrew Farrell

Nirav Praful Desai

Stanislava R Vlasseva

Stanislav Fritz

Nirav J Desai

Michael Luis Collado

Vijay Pratap Singh

Siamak Irantash

Gurbinder Gill

Slavik Dimitrovich

Venkata Uday Kumar Kalepalli Naga

Kyung Deuk Park

Suzuko Chida

Ravikumar Makam

An environment and techniques for intelligently selecting which tests of multiple different tests to run on a particular section or sections of code, such as one or more lines of code that a developer has altered, are described herein. In this manner, the techniques may allow developers to receive feedback on their software more quickly by running a subset of tests, rather than each test in a predefined set of tests.

Selecting appropriate subsets of software tests

An architecture and techniques for implementing a unified and extensible meta-testing framework within a distributed environment. This framework allows entities within the distributed environment to run tests written in different testing frameworks in a unified way. In addition, this disclosure describes techniques for allowing an entity within the distributed environment to test itself, both from its own perspective as well as from the perspective of other entities within the distributed environment.

Self-service testing

A stubbing service records requests and corresponding replies for purpose of playing back the recorded replies in response to re-receiving the corresponding requests. In a record mode, the stubbing service may receive a request from a first service intended for a second service. The stubbing service may send the request onto the second service and may, in response, receive a reply to the request from the second service. The stubbing service may then pass the reply onto the first service. When in a playback mode, the stubbing service may directly serve the stored reply to the first service in response to receiving the same request intended for the second service from the first service.

Stubbing techniques in distributed-services environments

Disclosed are various embodiments for generating a service call pattern for a system. A monitor is installed on a first and a second service call channel. Each service call channel is used by a first and second system under test, respectively. Through the monitor, service calls are received from the respective system under test. The service calls are issued to at least one service. A first service call pattern is generated based at least in part on the plurality of service calls issued by the first system under test. A second service call pattern is generated based at least in part on the plurality of service calls issued by the second under test. The first service call pattern report and the second service call pattern report are compared. An error condition if the comparison indicates a difference greater than a predefined threshold.

Generating service call patterns for systems under test

In some implementations, a testing service receives a test execution request for executing test operations on a test target. The testing service may map the test execution request to a particular type of supported test framework from among a plurality of types of supported test frameworks. The testing service may obtain a test package provided by a user that requested the testing, such as from a cloud storage location. The testing service determines a computing capacity for executing the testing and appropriates a plurality of workers in a cloud computing service. The testing service configures the plurality of workers for executing the test operations based on at least one of the test framework, the test execution request or the test package. The testing service provides test execution chunks from the test package to the plurality of workers for executing the testing on the test target.

Cloud-based test execution

Unified and extensible meta-testing framework

Growing community of inventors

Issaquah, WA, United States of America

Michael C Moore