Neural network load reduction device, information processing unit, and neural network load reduction method and computer-readable storage medium

Abstract

An information processing unit includes: an attention module having an attention layer and a computation section and that is for a neural network including plural levels of layer, the attention layer being configured to compute an output feature corresponding to an input feature from a predetermined layer and based on a parameter; the computation section that multiplies the input feature by the output feature, and outputs a computed result to a layer at a next level; the first learning unit connected to the neural network and that learns the parameter in a state in which learning has been suspended at least for the predetermined layer and the next level layer; and the channel selection section that selects as a redundant channel a channel satisfying a predetermined relationship between the output feature and a predetermined threshold value.