The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
May. 14, 2024

Filed:

Sep. 30, 2021
Applicant:

Yandex Europe Ag, Lucerne, CH;

Inventors:

Aleksei Sergeevich Petrov, Krasnoznamensk, RU;

Sergey Dmitrievich Gubanov, Tambov, RU;

Sergey Aleksandrovich Gaydaenko, g Mytishchi, RU;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G10L 15/00 (2013.01); G06F 40/166 (2020.01); G06F 40/40 (2020.01); G06N 3/045 (2023.01); G06N 3/08 (2023.01); G10L 13/02 (2013.01); G10L 15/06 (2013.01); G10L 15/16 (2006.01); G10L 15/22 (2006.01); G10L 15/30 (2013.01);
U.S. Cl.
CPC ...
G10L 15/063 (2013.01); G06F 40/166 (2020.01); G06F 40/40 (2020.01); G06N 3/045 (2023.01); G06N 3/08 (2013.01); G10L 13/02 (2013.01); G10L 15/16 (2013.01); G10L 15/22 (2013.01); G10L 15/30 (2013.01);
Abstract

Method and server for training an Attention-based Neural Network (ANN) to generate a textual output sequence being a content summary to be used as a response to a query. The ANN has an encoder and a decoder sub-network. The method includes, (i) inputting a query and input sequence into the encoder sub-network where the input sequence is a sequence of input groups associated with corresponding content snippets, (ii) generating an encoded representation of the input sequence, which includes generating attention-type outputs for respective words from the input sequence by applying an attention-limiting mask configured to attend only to words from the given input group, (iii) generating a decoded representation being a predicted textual output sequence, (iv) generating a penalty and (iii) adjusting the ANN based on the penalty score.


Find Patent Forward Citations

Loading…