The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Nov. 23, 2021

Filed:

Oct. 03, 2017
Applicant:

Google Llc, Mountain View, CA (US);

Inventors:

Navdeep Jaitly, Mountain View, CA (US);

Yu Zhang, Cambridge, MA (US);

Quoc V. Le, Sunnyvale, CA (US);

William Chan, Markham, CA;

Assignee:

Google LLC, Mountain View, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 40/47 (2020.01); G06N 3/08 (2006.01); G10L 15/16 (2006.01); G10L 15/197 (2013.01);
U.S. Cl.
CPC ...
G06F 40/47 (2020.01); G06N 3/084 (2013.01); G10L 15/16 (2013.01); G10L 15/197 (2013.01);
Abstract

A computer-implemented method for training a neural network that is configured to generate a score distribution over a set of multiple output positions. The neural network is configured to process a network input to generate a respective score distribution for each of a plurality of output positions including a respective score for each token in a predetermined set of tokens that includes n-grams of multiple different sizes. Example methods described herein provide trained neural networks which produce results with improved accuracy compared to the state of the art, e.g. translations that are more accurate compared to the state of the art, or more accurate speech recognition compared to the state of the art.


Find Patent Forward Citations

Loading…