Google Inc.

Yi Tay

Liu Yang

Donald Arthur Metzler, Jr

Da-Cheng Juan

Dara Bahri

A system for performing a machine learning task on a network input is described. The system includes one or more computers and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to implement (i) multiple sorting networks in which each sorting network is configured to sort vector blocks in a sequence of vector blocks to generate a sorted sequence of vector blocks; and (ii) a sorting attention neural network configured to perform the machine learning task on the input sequence by executing multiple sorting attention mechanisms using the sorting networks.

Growing community of inventors

Santa Clara, CA, United States of America

Yi Tay