Intuit, Inc.

Ido Farhi

Itay Margolin

Alexander Zhicharevich

Adi Shalev

Natalie Bar Eliyahu

Yonatan Ben-Simhon

Eilon Sheetrit

Nitzan Gado

Oren Dar

A Large Language Model (LLM) for classifying documents by identifying indicators within the documents. A smart caching mechanism stores document classifications and associated indicators output from the LLM. The database contains document details, classifications, and associated indicators. A classification module classifies a new document by analyzing it for indicators, checking the cache for a match, and querying the database for the indicators if no match is found. The module applies a majority vote based on the classifications associated with the indicators.

Methods and systems for implementing large language models and smart caching with zero shot

Embodiments disclosed herein may extract trending topics from phone call transcripts or any type of text data. The phone call transcripts may be collected for a time period and the time period may be divided into time spans. For each time span having more than a threshold number of phone call transcripts, n-grams from the phone call transcripts may be extracted. The extracted n-grams may be contextually clustered by converting the n-grams into their embedding vectors, reducing the dimensionality of the embedding vectors, and clustering similar reduced dimensionality embedding vectors. Normalized occurrences of one or more clusters may be generated. The recent mean of the number of occurrences of the normalized clusters may be compared with the historical mean and offset by historical standard deviation to generate a modified Z-score. N-grams corresponding to the clusters with high Z-scores may be identified as trending topics.

Unsupervised extraction of trends from call center transcripts

A method and computer system are provided for generating a text summary. An input text is processed by a model that comprises a set of attention heads. The model is trained to generate abstractive summaries of text documents. A subset of the attention heads are identified. For each attention head in the subset, a portion is identified from the input text that is used to generate the abstractive summary. For each sentence of the input text, a fractional size is calculated for an intersection of the portion and the respective sentence relative to the respective sentence. A subset of the sentences is then determined, where the respective fractional size of each sentence in the subset meets a first threshold. An extractive summary of the input text is then generated from the subset of sentences.

Extractive summary generation by abstractive trained model

Growing community of inventors

Tel Aviv, Israel

Ido Farhi