The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Jan. 07, 2025
Filed:
Sep. 29, 2022
Google Llc, Mountain View, CA (US);
Tara N. Sainath, Jersey City, NJ (US);
Rami Botros, Mountain View, CA (US);
Anmol Gulati, Mountain View, CA (US);
Krzysztof Choromanski, Mountain View, CA (US);
Ruoming Pang, New York, NY (US);
Trevor Strohman, Mountain View, CA (US);
Weiran Wang, Mountain View, CA (US);
Jiahui Yu, Mountain View, CA (US);
Google LLC, Mountain View, CA (US);
Abstract
A computer-implemented method includes receiving a sequence of acoustic frames as input to an automatic speech recognition (ASR) model. Here, the ASR model includes a causal encoder and a decoder. The method also includes generating, by the causal encoder, a first higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames. The method also includes generating, by the decoder, a first probability distribution over possible speech recognition hypotheses. Here, the causal encoder includes a stack of causal encoder layers each including a Recurrent Neural Network (RNN) Attention-Performer module that applies linear attention.