Vladimir Balayan

Title: Vladimir Balayan and AI Agents Trained Through Video Demonstrations.

Introduction

Vladimir Balayan is an inventor based in Santa Maria da Feira, Portugal. His work includes a patent for teaching computer-use artificial intelligence agents to reproduce interactions with user interfaces from video demonstrations. He is associated with Opnova, Inc.

Latest Patents

Balayan is credited with 1 patent: “Teaching Computer-Use Artificial Intelligence (AI) Agents from Video Demonstration.” The invention describes a process that uses a recording of a multi-step user-interface interaction, together with device input information, to identify a sequence of anchor actions. It selects frames immediately before and after those actions and uses them to generate a natural-language task prompt containing executable instructions.

The system runs the prompt to produce predicted actions, then compares those actions with the anchors from the recording. If they differ, the prompt is iteratively refined until the predicted actions match. The resulting prompt can then be used to replicate the demonstrated interaction.

Career Highlights

The patent highlights an approach to training computer-use AI agents from recorded demonstrations. By combining video, device inputs, action comparison, and iterative prompt refinement, the method aims to make it easier to teach agents multi-step tasks.

Collaborations

Balayan’s listed coworkers include Pedro Dos Santos Saleiro and Sinan Eren. His company affiliation is Opnova, Inc.

Conclusion

Vladimir Balayan’s patent presents a method for turning recorded user-interface demonstrations into refined instructions that help AI agents reproduce multi-step interactions.