Efficient second order pruning of computer-implemented neural networks

Abstract

A method for generating a simplified computer-implemented neural network. The method includes: receiving a predefined neural network, which includes a plurality of neural network structures and is described by weights, each neural network structure being assigned a pruning vector which describes a change in weights as a result of the pruning of the respective neural network; calculating a product of a matrix including a structure vector, the matrix including partial second order derivations of a loss function with respect to the plurality of weights; determining changes in the loss function with respect to the predefined neural network, each change occurring as a result of a pruning of a corresponding neural network structure of the two or more neural network structures to be pruned; and pruning at least one neural network structure based on the determined two or more changes in the loss function to generate the simplified neural network.