Remote control and monitoring of a locally executing generative agent

Abstract

The present disclosure relates to systems, non-transitory computer-readable media, and methods for remotely monitoring and/or modifying operations of a locally executing generative agent operating on an executing client device. In some embodiments, the disclosed systems can establish a persistent bi-directional connection between the executing client device and a backend runtime service. The disclosed systems can utilize the backend runtime service to construct a mirrored task object based on executable tasks performed by the locally executing generative agent. Further, the disclosed systems can provide a visual representation of the mirrored task object for display on a remote client device. Based on determining an interaction with the visual representation, the disclosed systems can utilize the persistent bi-directional connection to modify operations of the locally executing generative agent.