Orchestrator with semantic-based request routing for use in response generation using a trained generative language model

Abstract

A system is provided for managing specialized tasks and information retrieval processes. Agents are configured to perform tasks and/or retrieve information in a specialized domain. The system receives, via an interaction interface, a message from a user for the trained generative model to generate an output, generates a context of the message, generates a request including the context and the message, executes an orchestrator configured to: receive the request, determine, using semantic decision making, one or more agents to handle the request, input the request into one or more agents to perform a task and/or retrieve information in specialized domains, generate a prompt based on the retrieved information and/or the performed task and the message from the user, provide the prompt to the trained generative model, receive, in response to the prompt, a response from the trained generative model, and output the response to the user.