Deepmind Technologies Limited

Theophane Guillaume Weber

Razvan Pascanu

Peter William Battaglia

Oriol Vinyals

Nicolas Manfred Otto Heess

Ivo Danihelka

Yujia Li

Daniel Pieter Wierstra

Sebastien Henri Andre Racaniere

Lars Buesing

David Paul Reichert

Jack William Rae

Danilo Jimenez Rezende

Adam Anthony Santoro

Adrià Puigdomènech Badia

Karol Gregor

Arthur Clement Guez

Daniel Zorn

David Nunes Raposo

Ryan Faulkner

Nicholas Watters

Mike Chrzanowski

Adria Puigdomenech Badia

Georgios Papamakarios

Sebastien Henri Racaniere

Danilo Jiminez Rezende

A system including one or more computers and one or more storage devices storing instructions that when executed by the one or more computers cause the one or more computers to implement a memory and memory-based neural network is described. The memory is configured to store a respective memory vector at each of a plurality of memory locations in the memory. The memory-based neural network is configured to: at each of a plurality of time steps: receive an input; determine an update to the memory, wherein determining the update comprising applying an attention mechanism over the memory vectors in the memory and the received input; update the memory using the determined update to the memory; and generate an output for the current time step using the updated memory.

Neural networks with relational memory

A system implemented by one or more computers comprises a visual encoder component configured to receive as input data representing a sequence of image frames, in particular representing objects in a scene of the sequence, and to output a sequence of corresponding state codes, each state code comprising vectors, one for each of the objects. Each vector represents a respective position and velocity of its corresponding object. The system also comprises a dynamic predictor component configured to take as input a sequence of state codes, for example from the visual encoder, and predict a state code for a next unobserved frame. The system further comprises a state decoder component configured to convert the predicted state code, to a state, the state comprising a respective position and velocity vector for each object in the scene. This state may represent a predicted position and velocity vector for each of the objects.

Making object-level predictions of the future state of a physical system

A neural network system is proposed. The neural network can be trained by model-based reinforcement learning to select actions to be performed by an agent interacting with an environment, to perform a task in an attempt to achieve a specified result. The system may comprise at least one imagination core which receives a current observation characterizing a current state of the environment, and optionally historical observations, and which includes a model of the environment. The imagination core may be configured to output trajectory data in response to the current observation, and/or historical observations. The trajectory data comprising a sequence of future features of the environment imagined by the imagination core. The system may also include a rollout encoder to encode the features, and an output stage to receive data derived from the rollout embedding and to output action policy data for identifying an action based on the current observation.

Imagination-based agent neural networks

A neural network system is proposed to select actions to be performed by an agent interacting with an environment to perform a task in an attempt to achieve a specified result. The system may include a controller to receive state data and context data, and to output action data. The system may also include an imagination module to receive the state and action data, and to output consequent state data. The system may also include a manager to receive the state data and the context data, and to output route data which defines whether the system is to execute an action or to imagine. The system may also include a memory to store the context data.

Growing community of inventors

London, United Kingdom

Theophane Guillaume Weber