The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jun. 23, 2026
Filed:
Apr. 03, 2021
Microsoft Technology Licensing, Llc, Redmond, WA (US);
Yu Yan, Bellevue, WA (US);
Jiusheng Chen, Kirkland, WA (US);
Nikhil Bhendawade, Cupertino, CA (US);
Yeyun Gong, Beijing, CN;
Nan Duan, Beijing, CN;
Ruofei Zhang, Mountain View, CA (US);
Microsoft Technology Licensing, LLC, Redmond, WA (US);
Abstract
Computing technology is described herein that provides an attention mechanism, implemented by a neural network, that generates attention information based on head-specific query information and shared key and value (KV) information, without computing head-specific key information and head-specific value information, and without caching the head-specific key information and the head-specific value information in memory. This manner of operation allows the computing technology to make efficient use of processing and memory resources. In some implementations, the attention mechanism is part of decoder of an encoder-decoder system, or a standalone decoder system. In some implementations, the computing technology leverages the attention information to generate synthesized text based on input text.