Deepmind Technologies Limited

James Martens

Dilip Krishnan

Sven Adrian Gowal

Krishnamurthy Dvijotham

Chongli Qin

Robert Stanforth

Soham De

Alhussein Fawzi

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network. One of the methods includes processing each training input using the neural network and in accordance with the current values of the network parameters to generate a network output for the training input; computing a respective loss for each of the training inputs by evaluating a loss function; identifying, from a plurality of possible perturbations, a maximally non-linear perturbation; and determining an update to the current values of the parameters of the neural network by performing an iteration of a neural network training procedure to decrease the respective losses for the training inputs and to decrease the non-linearity of the loss function for the identified maximally non-linear perturbation.

Training more secure neural networks by using local linearity regularization

Growing community of inventors

London, United Kingdom

James Martens