Amazon Technologies, Inc.

Eric Brian Ceres

Saurabh Kumar Singh

Karthik Saligrama Shreeram

Yong Yuan

Ankit Sultania

Priyank Mundra

Techniques for request throttling in a provider network environment are described. A throttle handler controls whether requests will be processed through maintaining a token-based record, per type of request, having a token value indicative of a number of requests that can be processed over a time period. For a request, the token value of the token-based record corresponding to the request type is updated based on calculating an elapsed time between a last update time of the token-based record and the current time, calculating an intermediate token value as the existing token value plus a value of the elapsed time multiplied by a rate, and updating the token value to be the minimum between the intermediate token value and a burst value. The request is serviced when the updated token value is determined to be greater than or equal to a number of tokens needed to perform the request.

Growing community of inventors

Glen Rock, NJ, United States of America

Eric Brian Ceres