The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 19, 2026

Filed:

Mar. 30, 2022
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Jiading Gai, Seattle, WA (US);

Tobias Joseph Kastulus Edler Von Koch, Austin, TX (US);

Robert Geva, Cupertino, CA (US);

Paul Gilbert Meyer, Jericho, VT (US);

Donald John Kretsch, Cupertino, CA (US);

Ron Diamant, San Jose, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/02 (2006.01); G06F 8/41 (2018.01); G06F 9/38 (2018.01); G06F 17/16 (2006.01);
U.S. Cl.
CPC ...
G06N 3/02 (2013.01); G06F 8/443 (2013.01); G06F 9/3838 (2013.01); G06F 17/16 (2013.01);
Abstract

A technique for packing matrix multiplications for concurrent execution in an integrated circuit device may include obtaining a description of a neural network model, and generating an intermediate representation of the neural network model. Matrix multiplication instructions in the intermediate representation of the neural network model can then be vectorized for concurrent execution on an integrated circuit device, and machine instructions can be generated for the integrated circuit device based on the vectorized matrix multiplication instructions.


Find Patent Forward Citations

Loading…