The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Nov. 10, 2026
Filed:
May. 27, 2022
Gdm Holding Llc, Mountain View, CA (US);
Andrew Kyle Lampinen, Palo Alto, CA (US);
GDM Holding LLC, Mountain View, CA (US);
Abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing a machine learning task on a network input to generate a network output. One of the systems includes an attention neural network comprising one or more hierarchical attention blocks, each hierarchical attention block configured to: receive an input sequence for the hierarchical attention block; maintain a 5 plurality of memory summary keys, each memory summary key corresponding to a respective one of a plurality of partitions of a sequence of memory block inputs; determine a proper subset of the plurality of memory summary keys; and generate an attended input sequence for the hierarchical attention block including applying an attention mechanism over the respective memory block inputs at the memory positions within the partitions of 10 the sequence of memory block inputs that correspond to the proper subset of the plurality of memory summary keys.
Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile