Servicenow Canada Inc.

Microsoft Technology Licensing, LLC

Sandeep Subramanian

Jonathan Pilault

Raymond Li

Christopher Pal

Adam Trischler

Xingdi Yuan

Tong Wang

Christophe Pal

There is provided a non-transitory storage medium and a system for generating an abstractive summary of a document using an abstractive machine learning algorithm (MLA). A document including a plurality of text sequences is received. An extractive summary of the document is generated, the extractive summary including a set of summary text sequences which is a subset of the plurality of text sequences. The abstractive MLA generates, based on the set of summary text sequences and at least a portion of the plurality of text sequences, an abstractive summary of the document including a set of abstractive text sequences, at least one abstractive text sequence not being included in the plurality of text sequences.

Non-transitory computer-readable storage medium and system for generating an abstractive text summary of a document

There is provided a method and a system for training an extractive machine learning algorithm (MLA) to generate extractive summaries of text documents. Reference documents and associated extractive summaries are received. The extractive MLA is then trained to generate an extractive summary, where the training includes, for a given reference document, encoding, using a sentence encoder, a plurality of reference sentences to obtain an associated plurality of sentence representations, encoding, using a document encoder, the associated plurality of sentence representations to obtain a document representation, extracting, using a decoder and based on the associated plurality of sentence representations and the document representation, a first reference sentence of the plurality of reference sentences to obtain a first extracted sentence. A given parameter is updated based on the first extracted sentence and the given reference document summary. A trained extractive MLA comprising the updated given parameter is output.

Method of and system for training machine learning algorithm to generate text summary

A method and a system for generating an abstractive summary of a document using an abstractive machine learning algorithm (MLA) and a method and a system for training the abstractive MLA. A document including a plurality of text sequences is received. An extractive summary of the document is generated, the extractive summary including a set of summary text sequences which is a subset of the plurality of text sequences. The abstractive MLA generates, based on the set of summary text sequences and at least a portion of the plurality of text sequences, an abstractive summary of the document including a set of abstractive text sequences, at least one abstractive text sequence not being included in the plurality of text sequences. In some aspects, the extractive summary is generated by an extractive MLA having been trained to generate extractive summaries.

A method, system, and storage device storing a computer program, for generating questions based on provided content, such as, for example, a document having words. The method comprises automatically estimating the probability of interesting phrases in the provided content, and generating a question in natural language based on the estimating. In one example embodiment herein, the estimating includes predicting the interesting phrases as answers, and the estimating is performed by a neural model. The method further comprises conditioning a question generation model based on the interesting phrases predicted in the predicting, the question generation model generating the question. The method also can include training the neural model. In one example, the method further comprises identifying start and end locations of the phrases in the provided content, and the identifying includes performing a dot product attention mechanism parameterizing a probability distribution.

Growing community of inventors

Montreal, Canada

Sandeep Subramanian