Precision evaluation system for artificial intelligence generated text summaries

Abstract

A machine learning (ML) system and methods are provided that are configured to evaluate artificial intelligence (AI) generated text summaries using an evaluation framework for a weighting strategy of a plurality of metrics. The ML system includes a processor and a computer readable medium operably coupled thereto, the computer readable medium comprising a plurality of instructions stored in association therewith that are accessible to, and executable by, the processor, to perform summary evaluation operations which include accessing a AI generated text summary and an original text, calculating a plurality of summarization evaluation metrics, weighting the plurality of summarization evaluation metrics, computing a final evaluation score based on an aggregation of the weighted plurality of summarization evaluation metrics, outputting the precision evaluation based on the computed final evaluation score, and updating a data structure for the texts with the computed final evaluation score.