System and method for automated hashtag hierarchical ontology generation from social media data

Abstract

Aspects of the present disclosure provide systems, methods, apparatus, and computer-readable storage media for determining semantic relationships between hashtags in social media messages, particularly for use in generating a hierarchical ontology of hashtags based on co-occurrence frequency and diversity metrics. For example, natural language processing may be performed on a plurality of social media messages to extract hashtags from the social media messages. Co-occurrence frequency counts for at least two hashtags and other hashtags, in addition to an ensemble score based on a combination of one or more diversity metrics, may be determined. A hierarchical ontology may be generated based on the co-occurrence frequency counts and the ensemble scores for the at least two hashtags. Such a hierarchical ontology may group hashtags into communities of common topics that are ordered based on ensemble scores.