Training a neural network using an accelerated gradient with shuffling

Abstract

An index sequence specifying an index of training data corresponding to a component of a cost function is generated. A first model parameter in the set of model parameters is set to an initial value. Using the index sequence, a neural network model comprising a set of weights is trained. As part of the training, using the index sequence, a learning rate, and a set of gradients, a subset of the set of model parameters is updated. As part of the training, a momentum term is set. As part of the training, using the momentum term as the first model parameter, the updating and the setting are repeated until reaching a training completion condition. The trained neural network model is used to predict an outcome by analyzing live data.