Microsoft Technology Licensing, LLC

Dean Geckt

Roy Eisenstadt

Royi Ronen

Alexander Tsvetkov

Abed El Kader Asi

Abedelkader Asi

A computerized method categorizes questions from a transcript and provides those categorized questions to targets. A transcript associated with a meeting is obtained and a question in the obtained transcript is detected by a question detection model. A question vector embedding of the detected question is generated using a question clustering model and a category of the detected question is determined by the question clustering model using the generated question vector embedding and a plurality of category vector embeddings. A target of the detected question is identified using the determined category and the detected question is provided to the identified target via a question provision interface. Further, the question clustering model is used to generate the category vector embeddings from example questions of category question catalogs, such that the set of categories for which the question clustering model is configured can be efficiently modified.

Categorizing questions from a transcript using vector embeddings for information retrieval

The disclosure herein describes interpreting attention-based decisions of summarization outputs generated by a deep learning model. A decision interpretation model obtains attention values defining connections between input tokens associated with a source text and output tokens for a selected portion of a summary associated with the source text. The input tokens having the highest attention values indicating the strongest connections between the input tokens of the source text and an output token of the summary are selected as primary tokens. A semantic similarity between the primary tokens for each attention head and an output token is calculated. The model selects the primary tokens having the closest semantic similarity with the summary portion. A visual cue is generated on or within a portion of the source text corresponding to the primary tokens. The visual cue identifies dominant words in the source text used to explain the summary portion.

Interpreting summarization model decisions based on attention

A method of generating keyword-based dialogue summaries is provided. The method includes inputting a transcript of an audio conversation and a keyword into a machine learning model trained based on encodings representing the keyword and the transcript, generating computer-generated text different from and semantically descriptive of the transcript and semantically associated with the keyword, and outputting the computer-generated text in association with a selectable item selectable for inclusion of the computer-generated text in displayed text representing the transcript, the selectable item associated with the keyword.

Growing community of inventors

Haifa, Israel

Dean Geckt