The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Aug. 09, 2022

Filed:

Sep. 21, 2020
Applicant:

Salesforce.com, Inc., San Francisco, CA (US);

Inventors:

Bryan McCann, Menlo Park, CA (US);

Caiming Xiong, Mountain View, CA (US);

Richard Socher, Menlo Park, CA (US);

Assignee:

SALESFORCE.COM, INC., San Francisco, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 40/126 (2020.01); G06N 3/08 (2006.01); G06N 3/04 (2006.01); G06F 40/30 (2020.01); G06F 40/47 (2020.01); G06F 40/205 (2020.01); G06F 40/289 (2020.01); G06F 40/44 (2020.01); G06F 40/58 (2020.01);
U.S. Cl.
CPC ...
G06F 40/126 (2020.01); G06F 40/205 (2020.01); G06F 40/289 (2020.01); G06F 40/30 (2020.01); G06F 40/47 (2020.01); G06N 3/0445 (2013.01); G06N 3/0454 (2013.01); G06N 3/08 (2013.01); G06F 40/44 (2020.01); G06F 40/58 (2020.01);
Abstract

A system is provided for natural language processing. In some embodiments, the system includes an encoder for generating context-specific word vectors for at least one input sequence of words. The encoder is pre-trained using training data for performing a first natural language processing task. A neural network performs a second natural language processing task on the at least one input sequence of words using the context-specific word vectors. The first natural language process task is different from the second natural language processing task and the neural network is separately trained from the encoder. In some embodiments, the first natural processing task can be machine translation, and the second natural processing task can be one of sentiment analysis, question classification, entailment classification, and question answering.


Find Patent Forward Citations

Loading…