International Business Machines Corporation

Esther Goldbraich

Boaz Carmeli

Naama Tepper

George Kour

Ateret Anaby Tavor

Naama Zwerdling

Amir Kantor

Oren Sar-Shalom

Segev Shlomov

Anat Hashavit

Shiri Kremer-Davidson

Maya Barnea

In some examples, a system for generating a topic model includes a processor that can process a set of documents to generate training data, wherein each document in the set of documents is associated with one or more users. The processor can also generate a plurality of topic models using the training data, such that each topic model includes a different number of topics. The processor can also generate an evaluation score for each of the topic models based on information about the users associated with the documents included in the training data. The evaluation score describes a percentage of topics that exhibit a specified level of interest from a specified number of users. The processor can also identify a final topic model based on the evaluation scores and store the final topic model to be used in natural language processing.

Techniques for generating a topic model

Balancing an imbalanced dataset, by: Receiving a balancing policy and the imbalanced dataset. Performing initial adjustment of the imbalanced dataset to comply with the balancing policy, by: oversampling one or more underrepresented classes, and, if one or more of the classes are overrepresented, undersampling them. Operating a generative machine learning model to generate samples for the one or more underrepresented classes, based on the initially-adjusted dataset. Operating a machine learning classification model to label the generated samples with class labels corresponding to the one or more underrepresented classes. Selecting some of the generated samples which, according to the labeling, have a relatively high probability of preserving their class labels. Composing a balanced dataset which complies with the balancing policy and comprises: the samples belonging to the one or more underrepresented classes, the selected generated samples, and an undersampling of the samples belonging to the one or more overrepresented classes.

Dataset balancing via quality-controlled sample generation

Embodiments of the present systems and methods may provide techniques for augmenting textual data that may be used for textual classification tasks. Embodiments of such techniques may provide the capability to synthesize labeled data to improve text classification tasks. Embodiments may be specifically useful when only a small amount of data is available, and provide improved performance in such cases. For example, in an embodiment, a method implemented in a computer system may comprise a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, and the method may comprise fine-tuning a language model using a training dataset, synthesizing a plurality of samples using the fine-tuned language model, filtering the plurality of synthesized samples, and generating an augmented training dataset comprising the training dataset and the filtered plurality of synthesized sentences.

Language-model-based data augmentation method for textual classification tasks with little data

The present invention provides a method, computer program product, and system of generating prioritized list. In an embodiment, the method, computer program product, and system include receiving, by a computer system, target user identification data identifying a target user, target action data, social network content for the one or more users, and social network activity data for the one or more users, analyzing, by a computer system, social network links between the source user and the target user and the social network activity data for the one or more users, determining, by a computer system, a prioritized list of probabilistic action paths that could result in the target user performing the target action on the content based on the analyzing, and outputting the prioritized list to the source user.

Method and system for generating a prioritized list

Growing community of inventors

Haifa, Israel

Esther Goldbraich