The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 26, 2020

Filed:

Mar. 28, 2017
Applicant:

Facebook, Inc., Menlo Park, CA (US);

Inventors:

Jason E. Weston, New York, NY (US);

Arthur David Szlam, New York, NY (US);

Robert D. Fergus, Tuxedo Park, NY (US);

Sainbayar Sukhbaatar, Jersey City, NJ (US);

Assignee:

Facebook, Inc., Menlo Park, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06N 3/04 (2006.01); G06N 3/08 (2006.01); G06F 16/9032 (2019.01); G06F 40/279 (2020.01);
U.S. Cl.
CPC ...
G06N 3/0454 (2013.01); G06F 16/90332 (2019.01); G06F 40/279 (2020.01); G06N 3/0427 (2013.01); G06N 3/0445 (2013.01); G06N 3/084 (2013.01);
Abstract

Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.


Find Patent Forward Citations

Loading…