The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 13, 2022

Filed:

Mar. 05, 2019
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventor:

David Leen, Seattle, WA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorneys:
Primary Examiner:
Int. Cl.
CPC ...
H04L 41/16 (2022.01); H04L 67/1008 (2022.01); G06N 20/00 (2019.01); H04L 41/5009 (2022.01); H04L 43/16 (2022.01); H04L 67/60 (2022.01);
U.S. Cl.
CPC ...
H04L 41/16 (2013.01); G06N 20/00 (2019.01); H04L 41/5009 (2013.01); H04L 43/16 (2013.01); H04L 67/1008 (2013.01); H04L 67/32 (2013.01);
Abstract

A machine learning-based service processes requests using compressed and complete models to provide faster response times for servicing requests to process data. Initially, a host processes data using a compressed model that is stored in the host's memory and then switches to a larger, more accurate complete model after it is loaded into the host's memory. A host of the machine-learning based service may receive one or more requests to process data. In response, the host uses a compressed version of a model to begin processing the data. The host starts loading the complete version of the model into the host's memory. When the complete version of the model is loaded into memory, the host switches to process a remaining portion of the data using the complete version of the model.


Find Patent Forward Citations

Loading…