Deepmind Technologies Limited

Gdm Holding LLC

Benigno Uria-Martínez

Nal Emmerich Kalchbrenner

Alexander Benjamin Graves

Charles Blundell

Gregory Duncan Wayne

Ivo Danihelka

Raia Thais Hadsell

Andrea Banino

Sudarshan Kumaran

Alexander Pritzel

Adrià Puigdomènech Badia

Adria Puigdomenech Badia

Vinicius Zambaldi

Borja Ibarz Gabardos

A method includes maintaining respective episodic memory data for each of multiple actions; receiving a current observation characterizing a current state of an environment being interacted with by an agent; processing the current observation using an embedding neural network in accordance with current values of parameters of the embedding neural network to generate a current key embedding for the current observation; for each action of the plurality of actions: determining the p nearest key embeddings in the episodic memory data for the action to the current key embedding according to a distance measure, and determining a Q value for the action from the return estimates mapped to by the p nearest key embeddings in the episodic memory data for the action; and selecting, using the Q values for the actions, an action from the multiple actions as the action to be performed by the agent.

Neural episodic control

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting actions to be performed by an agent interacting with an environment. In one aspect, a system comprises a grid cell neural network and an action selection neural network. The grid cell network is configured to: receive an input comprising data characterizing a velocity of the agent; process the input to generate a grid cell representation; and process the grid cell representation to generate an estimate of a position of the agent in the environment; the action selection neural network is configured to: receive an input comprising a grid cell representation and an observation characterizing a state of the environment; and process the input to generate an action selection network output.

Performing navigation tasks using grid codes

Growing community of inventors

London, United Kingdom

Benigno Uria-Martínez