Automated generation of workflow documentation

Abstract

An artificial intelligence system (AIS) can generate documentation documents describing a user's workflow through capturing meaningful and event-based workflow information to provide in an LLM prompt. The system may receive user inputs indicating start of a workflow capture session, monitor a user's use of a software application for selective, meaningful triggers, generate screen captures based on detected triggers and determine associated metadata. The system may record audio. The system may receive user inputs indicating stop of a workflow capture session, transcribe recorded audio to generate a transcript, and may associate text of the transcript with the generated screen captures based on determined metadata. The AIS can generate a prompt for the LLM based on at least some of the meaningful workflow information. The prompt can include at least some of the generated screen captures and associated metadata, some of the transcript, and instructions to generate a documentation document.