Deepmind Technologies Limited

Tom Paine

Oriol Vinyals

Aaron Gerard Antonius Van Den Oord

Scott Ellison Reed

David Budden

Ziyu Wang

Sergio Gomez Colmenarejo

Yusuf Aytar

Alexander Novikov

Tobias Pfaff

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an action selection policy neural network, wherein the action selection policy neural network is configured to process an observation characterizing a state of an environment to generate an action selection policy output, wherein the action selection policy output is used to select an action to be performed by an agent interacting with an environment. In one aspect, a method comprises: obtaining an observation characterizing a state of the environment subsequent to the agent performing a selected action; generating a latent representation of the observation; processing the latent representation of the observation using a discriminator neural network to generate an imitation score; determining a reward from the imitation score; and adjusting the current values of the action selection policy neural network parameters based on the reward using a reinforcement learning training technique.

Action selection neural network training using imitation learning in latent space

Growing community of inventors

London, United Kingdom

Tom Paine