Google Inc.

Jamie Alexander Smith

Milad Olia Hashemi

Kevin Jordan Swersky

Parthasarathy Ranganathan

Brandon Carter

David Benjamin Belanger

Theodore Sanderson

Drew Bryant

Mark Andrew DePristo

Lucy Colwell

Maxwell Bileschi

Methods, systems, and apparatus, including computer programs encoded on computer storage media, relating to multi-task recurrent neural networks. One of the methods includes maintaining data specifying, for a recurrent neural network, a separate internal state for each of a plurality of memory regions; receiving a current input; identifying a particular memory region of the memory access address defined by the current input; selecting, from the internal states specified in the maintained data, the internal state for the particular memory region; processing, in accordance with the selected internal state for the particular memory region, the current input in the sequence of inputs using the recurrent neural network to: generate an output, the output defining a probability distribution of a predicted memory access address, and update the selected internal state of the particular memory region; and associating the updated selected internal state with the particular memory region in the maintained data.

Multi-task recurrent neural networks

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for predicting biological functions of proteins. In one aspect, a method comprises: obtaining data defining a sequence of amino acids in a protein; processing the data defining the sequence of amino acids in the protein using a neural network, wherein: the neural network is a convolutional neural network comprising one or more dilated convolutional layers; and the neural network is configured to process the data defining the sequence of amino acids in the protein in accordance with trained parameter values of the neural network to generate a neural network output characterizing at least one predicted biological function of the sequence of amino acids in the protein; and identifying the predicted biological function of the sequence of amino acids in the protein using the neural network output.

Predicting biological functions of proteins using dilated convolutional neural networks

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for pre-fetching data from memory using neural networks. One example system receives a sequence of prior program counter addresses of a computer program and corresponding delta values. The system creates an input representation based on the sequence. The system provides the input representation as input to a recurrent neural network. The system receives from the recurrent neural network an output that defines a probability distribution over future delta values. Each probability in the distribution represents a likelihood that execution of a future instruction of the computer program will cause data to be fetched from a particular future memory address.

Computer system prediction machine learning models

Growing community of inventors

Boston, MA, United States of America

Jamie Alexander Smith