Servicenow Canada Inc.

Raymond Li

Sandeep Subramanian

Jonathan Pilault

Christopher Pal

Christophe Pal

There is provided a non-transitory storage medium and a system for generating an abstractive summary of a document using an abstractive machine learning algorithm (MLA). A document including a plurality of text sequences is received. An extractive summary of the document is generated, the extractive summary including a set of summary text sequences which is a subset of the plurality of text sequences. The abstractive MLA generates, based on the set of summary text sequences and at least a portion of the plurality of text sequences, an abstractive summary of the document including a set of abstractive text sequences, at least one abstractive text sequence not being included in the plurality of text sequences.

Non-transitory computer-readable storage medium and system for generating an abstractive text summary of a document

There is provided a method and a system for training an extractive machine learning algorithm (MLA) to generate extractive summaries of text documents. Reference documents and associated extractive summaries are received. The extractive MLA is then trained to generate an extractive summary, where the training includes, for a given reference document, encoding, using a sentence encoder, a plurality of reference sentences to obtain an associated plurality of sentence representations, encoding, using a document encoder, the associated plurality of sentence representations to obtain a document representation, extracting, using a decoder and based on the associated plurality of sentence representations and the document representation, a first reference sentence of the plurality of reference sentences to obtain a first extracted sentence. A given parameter is updated based on the first extracted sentence and the given reference document summary. A trained extractive MLA comprising the updated given parameter is output.

Method of and system for training machine learning algorithm to generate text summary

A method and a system for generating an abstractive summary of a document using an abstractive machine learning algorithm (MLA) and a method and a system for training the abstractive MLA. A document including a plurality of text sequences is received. An extractive summary of the document is generated, the extractive summary including a set of summary text sequences which is a subset of the plurality of text sequences. The abstractive MLA generates, based on the set of summary text sequences and at least a portion of the plurality of text sequences, an abstractive summary of the document including a set of abstractive text sequences, at least one abstractive text sequence not being included in the plurality of text sequences. In some aspects, the extractive summary is generated by an extractive MLA having been trained to generate extractive summaries.

Growing community of inventors

Montreal, Canada

Raymond Li