Intuit, Inc.

Dhivya Arumugam

Jason Michael Webb

Anil Kumar Attuluri

Sagar Shukla

Rajendra Jayendra Gosavi

A Sushanth Kamath

Nandan B N

Karim Lakhani

Gokul Sarangapani

Mohamed Samy Ismail

Sushanth Kamath A

Venkata Krishna Murthy Vadrevu

Gourav Yadav

Akash Jain

Madhavan Narayanan

A method in a client backoff filter. The method includes receiving, from a server, a backoff data packet having backoff metadata. The method also includes saving the backoff metadata in a cache local to the client backoff filter. The method also includes receiving a subsequent request for service. The method also includes checking whether an attribute of the subsequent request for service matches the backoff metadata in the cache. The method also includes performing, responsive to checking, an action including at least one of the group including: blocking, responsive to the attribute matching the backoff metadata in the cache, transmission of the subsequent request for service to a server, and transmitting, responsive to the attribute failing to match the backoff metadata in the cache, the subsequent request for service to the server.

Client side backoff filter for rate limiting

A method including receiving, from a server, a backoff data packet including first information and second information. The first information includes a backoff command to cease transmitting at least some requests to a service executing on the server, and The second information includes metadata. The method also includes adding the backoff data packet to cached data stored in a cache. The method also includes receiving, from a client, a request data packet including a request for the service. The method also includes comparing request information, associated with the request data packet, to the cached data, including at least comparing the request information to the metadata. The method also includes blocking, responsive to a match between the request information and the cached data, the request data packet from being transmitted to the service.

Systems and methods for throttling requests to web services are disclosed. A system is configured to receive, at a host, one or more requests during a first time period. Each request is for a web service hosted on a backend. The host is one of a plurality of hosts of an application programming interface (API) gateway to receive a plurality of requests for the web services. The system is further configured to: process at least a portion of the one or more requests for the one or more web services; count, by a local counter in a local cache of the host, the one or more requests received at the host during the first time period; compare a local count of the local counter to a local bucket size associated with the host; and provide an instruction to update a remote count of a remote counter based on the comparison.

Scalable throttling of requests to web services

Growing community of inventors

Karnataka, India

Dhivya Arumugam