Amazon Technologies, Inc.

Ruhaab Markas

John Baker

Ganesh Kumar Gella

Kartik Natarajan

Santosh Kumar Ameti

Shahab Shekari

Satya Naga Satis Kumar Gunuputi Alluri Venka

Based on analysis of a workload associated with a throttling key of a client request directed to a first service, a scale-out requirement of the throttling key is obtained at respective resource managers of a plurality of other services which are utilized by the first service to respond to client requests. The resource managers initiate, asynchronously with respect to one another, resource provisioning tasks at each of the other services to fulfill the scale-out requirement. A throttling limit associated with the throttling key is updated to a second throttling key after the resource provisioning tasks are completed by the resource managers, and the updated limit is used to determine whether to accept another client request associated with the throttling key.

Growing community of inventors

The Colony, TX, United States of America

Ruhaab Markas