The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jun. 11, 2024

Filed:

Sep. 01, 2020
Applicant:

Amazon Technologies, Inc., Seattle, WA (US);

Inventors:

Thiam Khean Hah, Milpitas, CA (US);

Randy Renfu Huang, Morgan Hill, CA (US);

Richard John Heaton, San Jose, CA (US);

Ron Diamant, Santa Clara, CA (US);

Vignesh Vivekraja, Santa Clara, CA (US);

Assignee:

Amazon Technologies, Inc., Seattle, WA (US);

Attorney:
Primary Examiner:
Assistant Examiner:
Int. Cl.
CPC ...
G06N 3/08 (2023.01); G06F 13/20 (2006.01); G06N 3/04 (2023.01);
U.S. Cl.
CPC ...
G06N 3/08 (2013.01); G06F 13/20 (2013.01); G06N 3/04 (2013.01);
Abstract

A single neural network model can be used by each computing engine (CE) in a neural network processor to perform convolution operations in parallel for one or more stacks of convolutional layers. An input feature map can be divided into N chunks to be processed by N CEs, respectively. Each CE can process a last portion of a respective chunk to generate respective shared states to be used by a subsequent CE. A first CE uses pre-computed states to generate a first portion of an output feature map, while other CEs use shared states computed by a preceding CE to generate respective portions of the output feature map.


Find Patent Forward Citations

Loading…