Google Inc.

Jacob Daniel Devlin

Aakanksha Chowdhery

Sharan Narang, Jr

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output. One of the systems comprises an attention neural network configured to perform the machine learning task, the attention neural network comprising a plurality of attention layers, each attention layer comprising an attention sub-layer that is arranged in parallel with a feed-forward sub-layer.

Growing community of inventors

Ft. Myers, FL, United States of America

Jacob Daniel Devlin