Facebook, Inc.

Sainbayar Sukhbaatar

Robert D Fergus

Lubomir Dimitrov Bourdev

Jason Edward Weston

Balamanohar Paluri

Arthur David Szlam

Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.

End-to-end memory networks

Various embodiments of the present disclosure include systems, methods, and non-transitory computer storage media configured to identify a set of training content items, each of the set of training content items comprising video content. A category may be assigned to each of the set of training content items. A plurality of variations may be provided to the each of the set of training content items. A first content recognition module may be trained in an unsupervised process to associate the plurality of variations of the each of the set of training content items with the category assigned to the each of the set of training content items. A classification layer may be generated based on the training the first content recognition module in the unsupervised process. A second content recognition module may be trained in a supervised process based on the classification layer.

Growing community of inventors

Jersey City, NJ, United States of America

Sainbayar Sukhbaatar