logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 12265905 B1

PDFFull Text
Date of Patent:
Apr. 01, 2025

Filed:

Nov. 09, 2022

Computation of neural network node with large input values

Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Jung Ko, San Jose, CA (US);

Kenneth Duong, San Jose, CA (US);

Steven L. Teig, Menlo Park, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:

K&L Gates LLP

Primary Examiner:

Andrew Caldwell

Assistant Examiner:

Carlo Waje

Int. Cl.
CPC ...
G06F 7/544 (2006.01); G06F 1/03 (2006.01); G06F 5/01 (2006.01); G06F 9/30 (2018.01); G06F 17/10 (2006.01); G06F 17/16 (2006.01); G06N 3/048 (2023.01); G06N 3/06 (2006.01); G06N 3/063 (2023.01); G06N 3/08 (2023.01); G06N 3/084 (2023.01); G06N 5/04 (2023.01); G06N 5/046 (2023.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G06N 3/063 (2013.01); G06F 1/03 (2013.01); G06F 5/01 (2013.01); G06F 7/5443 (2013.01); G06F 9/30098 (2013.01); G06F 9/30145 (2013.01); G06F 17/10 (2013.01); G06F 17/16 (2013.01); G06N 3/048 (2023.01); G06N 3/06 (2013.01); G06N 3/08 (2013.01); G06N 3/084 (2013.01); G06N 5/04 (2013.01); G06N 5/046 (2013.01); G06N 20/00 (2019.01);
Abstract

Some embodiments provide a method for a circuit that executes a neural network including multiple nodes. The method loads a set of weight values for a node into a set of weight value buffers, a first set of bits of each input value of a set of input values for the node into a first set of input value buffers, and a second set of bits of each of the input values into a second set of input value buffers. The method computes a first dot product of the weight values and the first set of bits of each input value and a second dot product of the weight values and the second set of bits of each input value. The method shifts the second dot product by a particular number of bits and adds the first dot product with the bit-shifted second dot product to compute a dot product for the node.

Find Patent Forward Citations

Loading…