Amazon Technologies, Inc.

Terence Smith

Paul Derek DeMarco

Christopher Keakini Kaulia

Michael Shane Thyssen

Chaitanya Avinash Kulkarni

Zachary Jared Wiggins

David Y Yamanoha

Paul Walker Mooring

Rohit Rangan

A first node can be selected as a target node, and a second node can be selected as a control to determine a performance limit associated with providing a service. A request for the service can be determined to be routed to the first node. A first indication of a first performance measurement associated with processing a first load by the first node can be received. A second indication of a second performance measurement associated with processing a second load by the second node can be received. A performance error of the first node can be determined based on the first performance measurement and the second performance measurement. The performance limit can be determined based on the performance error, and an action can be triggered based on the performance limit.

Real-time load limit measurement for a plurality of nodes

Request routing in a network of computing devices. Back-end nodes associated with a request router send load reports to request routers. To select a back-end node for processing a request, a request router determines, based on the reports, estimated loads and corresponding errors of the estimated loads for respective nodes. A load balancing technique may be selected, based on the estimated loads and corresponding errors (e.g., round robin may be selected if the significance of an average error outweighs the difference between estimated load values for the nodes, or least estimated load may be selected of the difference between load values is greater than the average error). The selected technique is applied to choose one of the nodes to process the request. Load probability distribution may also be used for request routing, in combination with or separate from the selection based on the estimated loads.

Load balancing technique selection based on estimated load

Request routing in a network of computing devices. Back-end nodes associated with a request router send load reports to the request router that makes routing determinations for request from clients based on the reports. To select a back-end node for processing a request, a request router determines, based on the reports and one or more factors, load probability distributions for each of a group of back-end nodes selected from available back-end nodes. A load value is then randomly selected for each back-end node in the group, based on the node's probability distribution. The node in the group with the least randomly-selected value is chosen to process the request.

Load balancing based on randomized selection of a load value based on a load probability distribution

Growing community of inventors

Seattle, WA, United States of America

Terence Smith