Wells Fargo Bank, N.a.

Rahul Ignatius

Naveen Gururaja Yeri

Vinothkumar Venkataraman

Paul Davis

Ramesh Babu Sarvesetty

Renuka Mannem

Saurav Kumar

Systems, apparatuses, methods, and computer program products are disclosed for predicting an emotion in real-time based on a multimodal input including at least (i) an amount of keystrokes over a period of time and (ii) text. An example method may include receiving, by a communications circuitry, a multimodal input from a user including at least (i) an amount of keystrokes over a period of time and (ii) text. The example method may further include generating, by a trained machine learning model of an emotion prediction circuitry and using the multimodal input, an EmotionPrint for the user. The example method may finally include determining, by the emotion prediction circuitry and using the EmotionPrint, a next action.

Systems and methods for predicting an emotion based on a multimodal input

Systems, apparatuses, methods, and computer program products are disclosed for predicting an entity and intent based on captured speech. An example method includes capturing speech and converting the speech to text. The example method further includes causing generation of one or more entities and one or more intents based on the speech and the text. The example method further includes determining a next action based on each of the one or more entities and each of the one or more intents.

Systems and methods for determining a next action based on entities and intents

Systems, apparatuses, methods, and computer program products are disclosed for predicting an emotion based on speech and text derived from the speech. An example method includes capturing speech and generating hidden vectors based on the speech and text derived from the speech. The example method further includes generating a word aligned hidden vector based on the speech hidden vector and text hidden vector. The example method further includes generating a hidden vector based on the word aligned hidden vector and the text hidden vector. The example method further includes, after further processing of the final vector, generating one or more probabilities corresponding to one or more emotions. The example method finally includes determining a next action based on the generated one or more probabilities corresponding to one or more emotions.

Systems and methods for determining a next action based on a predicted emotion by weighting each portion of the action's reply

Systems, apparatuses, methods, and computer program products are disclosed for predicting an entity, intent, and emotion based on weighted and segmented portions of captured speech. An example method includes capturing speech and separating the speech and/or text derived from the speech into a plurality of discrete segments. The example method further includes determining or generating metadata, the metadata an entity, an intent, an emotion, and a weight associated with each of the entity, the intent, the emotion. The example method further includes determining a next action based on the determined or generated entity, intent, and emotion of each of the plurality of discrete segments.

Growing community of inventors

Bengaluru, India

Rahul Ignatius