Method and apparatus for a low energy programmable vector processing unit for neural networks backend processing

Abstract

An approach is described for a method and apparatus for a low energy programmable vector processing unit for use in processing such as for example neural network backend processing. According to some embodiments, this approach provides a pooling/vector processing unit for performing backend processing that implements a single issue multiple data (SIMD) datapath that performs various backend processing functions using only a single instruction. For instance, the present approach provides an apparatus and method for execution of operations in parallel using a single issued instruction to a plurality of processing cells. In some embodiments, there are multiple groups of processing cells for performing different operations—e.g. pooling, permute, sigmoid/tanh, and element wise operations. In some embodiments, the single instructions are provided by a programmable controller within the pooling/vector processing unit for issuing instructions which manages the retrieval and issuance of instructions within the pooling/vector processing unit.