Operation method and apparatus for network layer in deep neural network

Abstract

An operation method and apparatus for a network layer in a Deep Neural Network are provided. The method includes: acquiring a weighted tensor of the network layer in the Deep Neural Network, the weighted tensor comprising a plurality of filters; converting each filter into a linear combination of a plurality of fixed-point convolution kernels by splitting the filter, wherein a weight value of each of the fixed-point convolution kernels is a fixed-point quantized value having a specified bit-width; for each filter, performing a convolution operation on input data of the network layer and each of the fixed-point convolution kernels, respectively, to obtain a plurality of convolution results, and calculating a weighted sum of the obtained convolution results based on the linear combination of the plurality of fixed-point convolution kernels of the filter to obtain an operation result of the filter; determining output data of the network layer.