The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 04, 2020

Filed:

Jun. 07, 2019
Applicant:

Deepmind Technologies Limited, London, GB;

Inventors:

Nal Emmerich Kalchbrenner, London, GB;

Karen Simonyan, London, GB;

Lasse Espeholt, London, GB;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 40/58 (2020.01); G06N 3/04 (2006.01); G06F 40/44 (2020.01); G06N 3/08 (2006.01); G10L 15/197 (2013.01);
U.S. Cl.
CPC ...
G06F 40/58 (2020.01); G06F 40/44 (2020.01); G06N 3/0454 (2013.01); G06N 3/0472 (2013.01); G06N 3/084 (2013.01); G10L 15/197 (2013.01);
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for language modeling. In one aspect, a system comprises: a masked convolutional decoder neural network that comprises a plurality of masked convolutional neural network layers and is configured to generate a respective probability distribution over a set of possible target embeddings at each of a plurality of time steps; and a modeling engine that is configured to use the respective probability distribution generated by the decoder neural network at each of the plurality of time steps to estimate a probability that a string represented by the target embeddings corresponding to the plurality of time steps belongs to the natural language.


Find Patent Forward Citations

Loading…