International Business Machines Corporation

Leshem Choshen

Noam Slonim

Ranit Aharonov

Eyal Shnarch

Alon Halfon

Lena Dankin

Ariel Gera

An example system includes a processor to pre-train a transformer-based language model on a general domain. The processor can inter-train the pre-trained transformer-based language model using partitioning and classification to generate an inter-trained transformer-based pre-trained language model. The processor can then fine-tune the inter-trained transformer-based pre-trained language model on a target task to generate a fine-tuned transformer-based language model.

Growing community of inventors

Haifa, Israel

Leshem Choshen