Amazon Technologies, Inc.

Evan Corriere

Jacob Carr

Mohsen Azimi

Xinrui Li

Saravanan Rajagopal Coimbatore

Tristan Niles Cecil

Jason Adonis Timmons

Jizhou Liao

Sahil Sharma

Abhijit Prakash Bhatnagar

Huaqing Fang

Zi Yao Ding

Yusof Ganji

Techniques are disclosed to implement an adaptive testing service (ATS) capable of automatically generating test cases for a network service to adapt test coverage to observed behaviors of the network service. In embodiments, the ATS uses telemetry data from a production version of the network service to identify classes of testable behaviors. Test cases are generated for the behaviors and assigned weights based on frequency or recency metrics of the behaviors. The test cases are stored in a test case repository, and may be used to monitor the production version of the network service or verify code changes to a development version of the network service. The test case weights may be used to select which test cases to run or determine whether code changes should be accepted or rejected. The test cases are evolved over time to adapt to behavior changes in the network service.

Adaptive testing service that generates test cases from observed behaviors

A snapshot of a computer network system is taken in a virtualized environment. During a recording phase, a network message is recorded as it enters the computer network system. A logger generates log data that includes the headers of the network message as it enters and exits each server in the computer network system. An analysis server automatically analyzes the log data and determines whether there was a modification to a header of a network message and where the modification occurred. The contents of the changes reflected in the log data indicates functionality of the servers in the computer network system. The analysis server determines the dependencies between servers in the computer network system. The recorded data is used for test replays.

Reverse engineering computer network system functionality

Growing community of inventors

Sunnyvale, CA, United States of America

Evan Corriere