Amazon Technologies, Inc.

Vasanta Kumar Palisetti

Thomas A Volpe

Kiran Kalkunte Seshadri

Thomas Elmer

Fnu Arun Kumar

Systems and methods are provided to enable parallelized multiply-accumulate operations in a systolic array. Each row of the systolic array can include multiple busses enabling independent transmission of inputs along the respective bus. Each processing element of a given row-oriented bus can receive an input from a prior element of the given row-oriented bus, and perform arithmetic operations on the input. Each processing element can generate an output partial sum based on the arithmetic operations, provide the input to a next processing element of the given row-oriented bus, without the input being processed by a processing element of the row located between the two processing elements that uses a different row-oriented bus. Use of row-oriented busses can enable parallelization to increase speed or enable increased latency at individual processing elements.

Growing community of inventors

Santa Clara, CA, United States of America

Vasanta Kumar Palisetti