Neural network learning apparatus, neural network learning method and program

Abstract

There is provided a neural network learning apparatus capable of adjusting an amount of reduction in a model size. A group parameter generating part grouping model parameters of a neural network model into arbitrarily defined groups and generating group parameters indicating features of the groups, a regularization term calculating part calculating a regularization term on an assumption that distribution of the group parameters is according to distribution defined by hyper parameters which are parameters defining distribution features, and a model updating part calculating a loss function from correct labels in teacher data, output probability distribution obtained by inputting feature values corresponding to the correct labels in the teacher data to the neural network model, and a regularization term, and updating the neural network model in a manner that a value of the loss function is decreased are included.