International Business Machines Corporation

Ateret Anaby Tavor

Boaz Carmeli

David Amid

David Boaz

Amir Kantor

Naama Tepper

George Kour

Esther Goldbraich

Naama Zwerdling

Inbal Ronen

Ofer Lavi

Segev Shlomov

Eyal Ben-David

Alon Jacovi

Ori Bar El

Balancing an imbalanced dataset, by: Receiving a balancing policy and the imbalanced dataset. Performing initial adjustment of the imbalanced dataset to comply with the balancing policy, by: oversampling one or more underrepresented classes, and, if one or more of the classes are overrepresented, undersampling them. Operating a generative machine learning model to generate samples for the one or more underrepresented classes, based on the initially-adjusted dataset. Operating a machine learning classification model to label the generated samples with class labels corresponding to the one or more underrepresented classes. Selecting some of the generated samples which, according to the labeling, have a relatively high probability of preserving their class labels. Composing a balanced dataset which complies with the balancing policy and comprises: the samples belonging to the one or more underrepresented classes, the selected generated samples, and an undersampling of the samples belonging to the one or more overrepresented classes.

Dataset balancing via quality-controlled sample generation

The computer receives a group of conversation data associated with the escalation node, identifies agent responses in the conversation data, and clusters them into agent response types. The computer identifies dialog state feature value sets for the conversations. The computer identifies feature value set associations with response types, and generates, Boolean expressions representing the feature value sets associated with each of the response types. The computer makes a recommendation to add to at least one child node for the escalation node, with the child node corresponding to one of the response types. The child node has, as an entry condition, the Boolean expression for the response type to which the child node corresponds. The child node has as an action, which according to some aspects, provides a response representative of the cluster of agent responses for the response type to which the child node corresponds.

Computerized dialog system improvements based on conversation data

Embodiments may determine user intent in conversations with dialogue systems so as to improve the quality of such conversations and to reduce the number of failed conversations. For example, a method may comprise receiving, at a dialogue system, a first text utterance from a user, generating a plurality of second text utterances at the dialogue system in response to the received text utterance, generating a third text utterance based on each generated second text utterance using a trained deep neural network model, generating a score indicating a quality of each conversation, wherein each conversation includes the first text utterance, one of the second text utterances, and the third text utterance based on the one of the second text utterances, and outputting to the user the second text utterance included in the conversation having the highest quality score.

User utterance generation for counterfactual analysis and improved conversation flow

Embodiments of the present systems and methods may provide techniques for augmenting textual data that may be used for textual classification tasks. Embodiments of such techniques may provide the capability to synthesize labeled data to improve text classification tasks. Embodiments may be specifically useful when only a small amount of data is available, and provide improved performance in such cases. For example, in an embodiment, a method implemented in a computer system may comprise a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, and the method may comprise fine-tuning a language model using a training dataset, synthesizing a plurality of samples using the fine-tuned language model, filtering the plurality of synthesized samples, and generating an augmented training dataset comprising the training dataset and the filtered plurality of synthesized sentences.

Language-model-based data augmentation method for textual classification tasks with little data

A method comprising operating a computerized chatbot to: calculate first and second scores representing a relevance of input received from a user to functionalities provided by respective first and second modules, respectively, of the chatbot; associate the first and second modules with respective first and second names; introducing the modules to the user using their associated names; selecting a module to interact with the user based on at least one of: a name mentioned by the user and a score and switching between the first and second modules based on the names.

System and method for operating a chatbot

Growing community of inventors

Givat Ada, Israel

Ateret Anaby Tavor