Microsoft Technology Licensing, LLC

Ryan H Volum

William B Dolan

Christopher John Brockett

Shawn Cantin Callegari

Devis Lucato

Adrian Bonar

Benjamin David Van Durme

Gabriel Arien Desgarennes

Jennifer Fox

Mollie Munoz

Sudha Rao

Nicole E Berdy

Hamid Palangi

The techniques disclosed herein enable systems for spoken natural stylistic conversations with large language models. In contrast to many existing modalities for interacting with large language models that are limited to text, the techniques presented herein enable users to carry a fully spoken conversation with a large language model. This is accomplished by converting a user speech audio input to text and utilizing a prompt engine to analyze a sentiment expressed by the user. A large language model, having been trained on example conversations, by generating a text response as well as a style cue to express emotion in response to the sentiment expressed by speech audio input. A text-to-speech engine can subsequently interpret the text response and style cue to generate an audio output which emulates the sensation of human conversation.

Real-time system for spoken natural stylistic conversations with large language models

Aspects of the present disclosure relate to a personalized agent service that generates and evolves customized agents that can be instantiated in-game to play with users. Machine learning models are trained to control the agent's interactions with the game environment and the user during gameplay. A user may request that a personalized agent join the user's gameplay session. The user device sends a request for the personalized agent to a game platform. The game platform determines whether the user has a license to execute a second instance of the game. When the user has a license to execute a second instance of the game, the second instance of the game may be executed on the user device. Information received from a personalized agent service is used to instantiate a personalized agent in the second instance of the game.

Importing agent personalization instantiate a personalized agent in a user game session

Growing community of inventors

Seattle, WA, United States of America

Ryan H Volum