The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 10, 2026

Filed:

Jan. 30, 2023
Applicant:

Gdm Holding Llc, Mountain View, CA (US);

Inventors:

Curtis Glenn-Macway Hawthorne, Sunnyvale, CA (US);

Andrew Coulter Jaegle, London, GB;

Catalina-Codruta Cangea, Cambridge, GB;

Sebastian Borgeaud Dit Avocat, London, GB;

Charlie Thomas Curtis Nash, London, GB;

Mateusz Malinowski, London, GB;

Sander Etienne Lea Dieleman, London, GB;

Oriol Vinyals, London, GB;

Matthew Botvinick, Philadelphia, PA (US);

Ian Stuart Simon, San Francisco, CA (US);

Hannah Rachel Sheahan, London, GB;

Neil Zeghidour, Paris, FR;

Jean-Baptiste Alayrac, London, GB;

Joao Carreira, St. Albans, GB;

Jesse Engel, Orinda, CA (US);

Assignee:

GDM Holding LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/045 (2023.01); G06N 3/044 (2023.01);
U.S. Cl.
CPC ...
G06N 3/044 (2023.01);
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a sequence of data elements that includes a respective data element at each position in a sequence of positions. In one aspect, a method includes: for each position after a first position in the sequence of positions: obtaining a current sequence of data element embeddings that includes a respective data element embedding of each data element at a position that precedes the current position, obtaining a sequence of latent embeddings, and processing: (i) the current sequence of data element embeddings, and (ii) the sequence of latent embeddings, using a neural network to generate the data element at the current position. The neural network includes a sequence of neural network blocks including: (i) a cross-attention block, (ii) one or more self-attention blocks, and (iii) an output block.


Find Patent Forward Citations

Quick Actions:

Hawthorne, Curtis Glenn-Macway. (2026). Generating sequences of data elements using cross-attention operations (U.S. Patent No. 12792876). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12792876

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…