The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 11, 2022

Filed:

Mar. 22, 2021
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Christopher Kakovitch, Seattle, WA (US);

Nils Anders Palumbo, Kirksville, MO (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
H04L 47/78 (2022.01); H04L 45/42 (2022.01); H04L 47/125 (2022.01); H04L 47/762 (2022.01);
U.S. Cl.
CPC ...
H04L 47/781 (2013.01); H04L 45/42 (2013.01); H04L 47/125 (2013.01); H04L 47/762 (2013.01);
Abstract

Systems and methods are described for allocating requests to implement new workloads within a heterogenous fleet. The fleet can include various sub-fleets, each corresponding to a set of computing devices having a given configuration of computing resources. A routing device can calculate n-dimensional decision surfaces that map expected resource usage associated with an incoming request to probabilities to route the request to each sub-fleet. The decision surfaces can be calculated to maximize cost-weighted headroom across the sub-fleets, with headroom on each sub-fleet reflecting a geometrical dissimilarity in a shape of load on the sub-fleet and a shape of resources available on the sub-fleet. By comparing the expected resource usage associated with the incoming request to the decision surfaces, the device can determine a sub-fleet to which to route the requests.


Find Patent Forward Citations

Loading…