The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Aug. 23, 2022
Filed:
Jun. 27, 2018
Amazon Technologies, Inc., Seattle, WA (US);
Sudipta Sengupta, Redmond, WA (US);
Poorna Chand Srinivas Perumalla, Seattle, WA (US);
Dominic Rajeev Divakaruni, Seattle, WA (US);
Nafea Bshara, Cupertino, CA (US);
Leo Parker Dirac, Seattle, WA (US);
Bratin Saha, Cupertino, CA (US);
Matthew James Wood, Seattle, WA (US);
Andrea Olgiati, Gilroy, CA (US);
Swaminathan Sivasubramanian, Sammamish, WA (US);
Amazon Technologies, Inc., Seattle, WA (US);
Abstract
Implementations detailed herein include description of a computer-implemented method. In an implementation, the method at least includes provisioning an application instance and portions of at least one accelerator attached to the application instance to execute a machine learning model of an application of the application instance; loading the machine learning model onto the portions of the at least one accelerator; receiving scoring data in the application; and utilizing each of the portions of the attached at least one accelerator to perform inference on the scoring data in parallel and only using one response from the portions of the accelerator.