Keyphrase extraction system and method

Abstract

A keyphrase extraction system and method is provided. The keyphrase extraction system includes a memory having computer-readable instructions stored therein. The keyphrase extraction system also includes a processor configured to access a document. The processor is configured to identify a plurality of candidate phrases from the document based upon a part-of-speech tag pattern. Each of the plurality of candidate phrases comprises one or more candidate terms. In addition, the processor is further configured to access an external knowledge base to determine a vocabulary frequency count of the one or more candidate terms. The vocabulary frequency count of the one or more candidate terms corresponds to a count of appearance of the respective candidate term in a plurality of documents accessible by the external knowledge base. Further, the processor is configured to estimate a phrase score for each of the plurality of candidate phrases based upon the vocabulary frequency count of the one or more candidate terms of each of the plurality of candidate phrases. Furthermore, the processor is configured to filter the plurality of candidate phrases based upon the estimated phrase score and pre-determined thresholds to determine one or more key phrases present in the document.