Amazon Technologies, Inc.

Ankit Sultania

Saurabh Kumar Singh

Yong Yuan

Peng Xu

Sudipta Sengupta

Bing Xiang

Ramesh M Nallapati

Zhiguo Wang

Dimitrios Soulios

Karthik Saligrama Shreeram

Xiaofei Ma

Zhiheng Huang

Dong Wang

Krishnakumar Rajagopalan

Eric Brian Ceres

Priyank Mundra

Jean-Pierre Dodel

Milan Saini

Techniques for request throttling in a provider network environment are described. A throttle handler controls whether requests will be processed through maintaining a token-based record, per type of request, having a token value indicative of a number of requests that can be processed over a time period. For a request, the token value of the token-based record corresponding to the request type is updated based on calculating an elapsed time between a last update time of the token-based record and the current time, calculating an intermediate token value as the existing token value plus a value of the elapsed time multiplied by a rate, and updating the token value to be the minimum between the intermediate token value and a burst value. The request is serviced when the updated token value is determined to be greater than or equal to a number of tokens needed to perform the request.

Systems, apparatuses, and methods for request throttling

Techniques for searching documents are described. An exemplary method includes receiving a document search query; querying at least one index based upon the document search query to identify matching data; fetching the identified matched data; determining one or more of a top ranked passage and top ranked documents from the set of documents based upon one or more invocations of one or more machine learning models based at least on the fetched identified matched data and the document search query; and returning one or more of the top ranked passage and the proper subset of documents.

Systems, apparatuses, and methods for document querying

Growing community of inventors

Seattle, WA, United States of America

Ankit Sultania