Constrained output generation for large language models

Abstract

Systems, methods, and devices for generating constrained outputs for large language models are disclosed. The system receives an input query relating to a request from a user via a user interface associated with an entity. The system retrieves knowledge elements from a proprietary knowledge corpus, including frameworks, methodologies, or constraints specific to the entity. For each knowledge element, the system inputs the query and knowledge element into a large language model to generate a preliminary output. The system applies user-specific rules to generate a constrained output by parsing the preliminary output, evaluating response components against user-specific constraints as logical predicates, and modifying components that violate rules. The system generates citations linking outputs to source identifiers, aggregates the constrained outputs and citations to generate a composite response, and transmits it to the user interface.