The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 14, 2023
Filed:
Jun. 29, 2020
Amazon Technologies, Inc., Seattle, WA (US);
Ankit Sultania, Seattle, WA (US);
Eric Brian Ceres, Glen Rock, NJ (US);
Karthik Saligrama Shreeram, Seattle, WA (US);
Yong Yuan, Mercer Island, WA (US);
Saurabh Kumar Singh, Sammamish, WA (US);
Priyank Mundra, Seattle, WA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Techniques for request throttling in a provider network environment are described. A throttle handler controls whether requests will be processed through maintaining a token-based record, per type of request, having a token value indicative of a number of requests that can be processed over a time period. For a request, the token value of the token-based record corresponding to the request type is updated based on calculating an elapsed time between a last update time of the token-based record and the current time, calculating an intermediate token value as the existing token value plus a value of the elapsed time multiplied by a rate, and updating the token value to be the minimum between the intermediate token value and a burst value. The request is serviced when the updated token value is determined to be greater than or equal to a number of tokens needed to perform the request.