Microsoft Technology Licensing, LLC

Nicole E Berdy

Arjmand Samuel

Rajeev Mandayam Vokkarne

Konstantin Dotchkoff

Jelani Zukar Brandon

Mounica Arroju

Alexander I Tolpin

Timothy James Larden

Devis Lucato

Shawn Cantin Callegari

Tamer Awad

Puneet Gupta

Adrian Bonar

Ryan H Volum

Jennifer Fox

Mollie Munoz

Tamer A Awad

Sachinkumar Chandramohan

The techniques disclosed herein enable systems for spoken natural stylistic conversations with large language models. In contrast to many existing modalities for interacting with large language models that are limited to text, the techniques presented herein enable users to carry a fully spoken conversation with a large language model. This is accomplished by converting a user speech audio input to text and utilizing a prompt engine to analyze a sentiment expressed by the user. A large language model, having been trained on example conversations, by generating a text response as well as a style cue to express emotion in response to the sentiment expressed by speech audio input. A text-to-speech engine can subsequently interpret the text response and style cue to generate an audio output which emulates the sensation of human conversation.

Real-time system for spoken natural stylistic conversations with large language models

Growing community of inventors

Cambridge, MA, United States of America

Nicole E Berdy