The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 01, 2020

Filed:

Nov. 23, 2018
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Vivek Bhadauria, Redmond, WA (US);

Praveenkumar Udayakumar, Seattle, WA (US);

Jonathan Andrew Hedley, Seattle, WA (US);

Vasant Manohar, Redmond, WA (US);

Andrea Olgiati, Gilroy, CA (US);

Rakesh Madhavan Nambiar, Seattle, WA (US);

Gowtham Jeyabalan, Redmond, WA (US);

Shubham Chandra Gupta, Seattle, WA (US);

Palak Mehta, Sammamish, WA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 9/46 (2006.01); G06F 9/50 (2006.01);
U.S. Cl.
CPC ...
G06F 9/5044 (2013.01); G06F 9/505 (2013.01); G06F 9/5077 (2013.01); G06F 2209/508 (2013.01); G06F 2209/5011 (2013.01);
Abstract

Techniques are described for automatically scaling (or 'auto scaling') compute resources—for example, virtual machine (VM) instances, containers, or standalone servers—used to support execution of service-oriented software applications and other types of applications that may process heterogeneous workloads. The resource requirements for a software application can be approximated by measuring 'worker pool' utilization of instances of each service, where a worker pool represents a number of requests that the service can process concurrently. A scaling service can thus be configured to scale the compute instances provisioned for a service in proportion to worker pool utilization, that is, compute instances can be added as the fleet's worker pools become more “busy,” while compute instances can be removed when worker pools become inactive.


Find Patent Forward Citations

Loading…