International Business Machines Corporation

Matan Vetzler

Boaz Carmeli

Ateret Anaby-Tavor

Koren Ran Lazar

A computer-implemented method, system and computer program product for identifying a semantic representation for a set of texts. The set of texts is encoded using a language model to obtain a set of corresponding texts' contextualized embeddings. A centroid of the contextualized embeddings is then calculated. A user-designated number of words from a pre-defined vocabulary of the language model that have their non-contextualized embeddings closest to the centroid are then identified. Furthermore, permutations of the identified words are calculated using an n-gram range. The permutations are then encoded using the language model in a contextualized manner. The encoded permutation from the encoded permutations with the greatest similarity to the centroid is identified. The identified encoded permutation is then assigned as the semantic representation of the set of texts. In this manner, the semantic representation is more effectively identified by expanding the embedding space upon which the semantic representation is chosen.

Growing community of inventors

Givat Shmuel, Israel

Matan Vetzler