Anomalous text detection and entity identification using exploration-exploitation and pre-trained language models

Abstract

There is a need for more effective and efficient anomalous text detection. This need can be addressed by, for example, solutions for anomalous text detection that include the steps of performing a group of exploration-exploitation keyword extraction iterations based at least in part on one or more training corpus data entries until a per-iteration keyword list for an ultimate exploration-exploitation keyword extraction iteration satisfies a keyword list threshold condition; and subsequent to performing the exploration-exploitation keyword extraction iterations: processing one or more input corpus data entries using the language-model-based binary classification model to generate one or more inferred anomaly probabilities, processing the one or more input corpus data entries using the keyword model to generate explanatory metadata for the one or more inferred anomaly probabilities, and performing one or more prediction-based actions based at least in part on the one or more inferred anomaly probabilities and the explanatory metadata.