The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jul. 08, 2025
Filed:
May. 22, 2020
Google Llc, Mountain View, CA (US);
Jonathon Shlens, San Francisco, CA (US);
Ashish Teku Vaswani, San Francisco, CA (US);
Niki J. Parmar, Sunnyvale, CA (US);
Prajit Ramachandran, Santa Clara, CA (US);
Anselm Caelifer Levskaya, Oakland, CA (US);
Irwan Bello, San Francisco, CA (US);
Google LLC, Mountain View, CA (US);
Abstract
A system implemented as computer programs on one or more computers in one or more locations that implements a computer vision model is described. The computer vision model includes a positional local self-attention layer that is configured to receive an input feature map and to generate an output feature map. For each input element in the input feature map, the positional local self-attention layer generates a respective output element for the output feature map by generating a memory block including neighboring input elements around the input element, generates a query vector using the input element and a query weight matrix, for each neighboring element in the memory block, performs positional local self-attention operations to generate a temporary output element, and generates the respective output element by summing temporary output elements of the neighboring elements in the memory block.