Deepmind Technologies Limited

Google Inc.

Guillaume Desjardins

Koray Kavukcuoglu

Razvan Pascanu

Raia Thais Hadsell

James Kirkpatrick

Hubert Josef Soyer

Andrei-Alexandru Rusu

Neil Charles Rabinowitz

Jean-Philippe Paul Cormier

Karen Simonyan

Joel William Veness

Methods and systems for performing a sequence of machine learning tasks. One system includes a sequence of deep neural networks (DNNs), including: a first DNN corresponding to a first machine learning task, wherein the first DNN comprises a first plurality of indexed layers, and each layer in the first plurality of indexed layers is configured to receive a respective layer input and process the layer input to generate a respective layer output; and one or more subsequent DNNs corresponding to one or more respective machine learning tasks, wherein each subsequent DNN comprises a respective plurality of indexed layers, and each layer in a respective plurality of indexed layers with index greater than one receives input from a preceding layer of the respective subsequent DNN, and one or more preceding layers of respective preceding DNNs, wherein a preceding layer is a layer whose index is one less than the current index.

Progressive neural networks

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a whitened neural network layer. One of the methods includes receiving an input activation generated by a layer before the whitened neural network layer in the sequence; processing the received activation in accordance with a set of whitening parameters to generate a whitened activation; processing the whitened activation in accordance with a set of layer parameters to generate an output activation; and providing the output activation as input to a neural network layer after the whitened neural network layer in the sequence.

Whitened neural network layers

A computing device may schedule transmission of software packages on a broadcast/multicast downlink channel. The schedule may also include media transmissions on the channel, and the software package transmissions may be scheduled for times when the media transmissions are using less than or equal to a threshold capacity level of the channel. A software update request may be received from a wireless computing device. Possibly in response to receiving the software update request, a particular software package related to the wireless computing device may be determined. The particular software package may be scheduled to begin transmission on the channel at a particular time. At least an identifier of the channel and the particular time may be transmitted to the wireless computing device.

Scheduling of software package transmissions on a multimedia broadcast multicast service channel

Growing community of inventors

London, United Kingdom

Guillaume Desjardins