The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 21, 2021
Filed:
Nov. 24, 2017
Applicant:
Amazon Technologies, Inc., Seattle, WA (US);
Inventors:
Stefano Stefani, Issaquah, WA (US);
Steven Andrew Loeppky, Seattle, WA (US);
Thomas Albert Faulhaber, Jr., Seattle, WA (US);
Craig Wiley, Redmond, WA (US);
Edo Liberty, New York, NY (US);
Assignee:
Amazon Technologies, Inc., Seattle, WA (US);
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/02 (2006.01); G06F 9/455 (2018.01); G06N 20/00 (2019.01); G06F 9/50 (2006.01); G06Q 10/10 (2012.01); H04L 12/24 (2006.01); H04L 12/26 (2006.01); H04L 29/12 (2006.01);
U.S. Cl.
CPC ...
G06N 20/00 (2019.01); G06F 9/45558 (2013.01); G06F 9/5072 (2013.01); G06N 3/02 (2013.01); G06F 2009/45595 (2013.01); G06Q 10/10 (2013.01); H04L 41/147 (2013.01); H04L 43/08 (2013.01); H04L 61/2007 (2013.01); H04L 61/256 (2013.01);
Abstract
Techniques for auto-scaling hosted machine learning models for production inference are described. A machine learning model can be deployed in a hosted environment such that the infrastructure supporting the machine learning model scales dynamically with demand so that performance is not impacted. The model can be auto-scaled using reactive techniques or predictive techniques.