Deepmind Technologies Limited

Gdm Holding LLC

Tom Erez

David Silver

Timothy Paul Lillicrap

Nicolas Manfred Otto Heess

Daniel Pieter Wierstra

Alexander Pritzel

Yuval Tassa

Jonathan James Hunt

Oriol Vinyals

Joao Ferdinando Gomes De Freitas

Jack William Rae

Gabriel Barth-Maron

Misha Man Ray Denil

Alexander Novikov

Emilio Parisotto

Jacob Bruce

Ashley Deloris Edwards

Scott Ellison Reed

Sergio Gomez

Konrad Zolna

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent to interact with an environment using an action selection neural network. In one aspect, a method comprises, at each time step in a sequence of time steps: generating a current representation of a state of a task being performed by the agent in the environment as of the current time step as a sequence of data elements; autoregressively generating a sequence of data elements representing a current action to be performed by the agent at the current time step; and after autoregressively generating the sequence of data elements representing the current action, causing the agent to perform the current action at the current time step.

Autoregressively generating sequences of data elements defining actions to be performed by an agent

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training an actor neural network used to select actions to be performed by an agent interacting with an environment. One of the methods includes obtaining a minibatch of experience tuples; and updating current values of the parameters of the actor neural network, comprising: for each experience tuple in the minibatch: processing the training observation and the training action in the experience tuple using a critic neural network to determine a neural network output for the experience tuple, and determining a target neural network output for the experience tuple; updating current values of the parameters of the critic neural network using errors between the target neural network outputs and the neural network outputs; and updating the current values of the parameters of the actor neural network using the critic neural network.

Continuous control with deep reinforcement learning

Growing community of inventors

London, United Kingdom

Tom Erez