Generative model evaluation and improvement pipeline

Abstract

This disclosure describes systems that evaluating generative queries and modifying generative models (e.g., large language models or LLMs) and/or their system prompts based on the evaluation. The disclosed systems can generate and maintain a generative model functionality codex that stores tags for prompts and responses (to capture behaviors and intents of users and LLMs or other generative models). Using the codes, the disclosed systems can update evaluation model generation and can update queries and/or model parameters based on the evaluation. The disclosed systems can further distill models using updated queries and/or learned model parameters.