Digital image analysis of social media posts using machine learning models for sentiment identification and recommended actions

Abstract

A machine learning (ML) system and methods are provided that are configured to correlate text data with corresponding image data for image sentiment analysis. The system includes a processor and a computer readable medium operably coupled thereto, the computer readable medium comprising a plurality of instructions stored in association therewith that are accessible to, and executable by, the processor, to perform image processing operations which include receiving image data for an image posted on a social networking platform, determining whether there is text data, performing image data extraction operations, analyzing the text data, determining and combining a score for the image and text data, determining an image sentiment or a text sentiment, calculating weighted metrics based on the image sentiment or the text sentiment, determining historical customer data interactions of the customer, and recommending one or more actions based on the weighted metrics.