Training neural networks using evolution based strategies and novelty search

Abstract

Systems and methods are disclosed herein for selecting a parameter vector from a set of parameter vectors for a neural network and generating a plurality of copies of the parameter vector. The systems and methods generate a plurality of modified parameter vectors by perturbing each copy of the parameter vector with a different perturbation seed, and determine, for each respective modified parameter vector, a respective measure of novelty. The systems and methods determine an optimal new parameter vector based on each respective measure of novelty for each respective one of the plurality of modified parameter vectors, and determine behavior characteristics of the new parameter vector. The systems and methods store the behavior characteristics of the new parameter vector in an archive.