Uipath Inc.

Michael Aristo Leonard, Ii

Cosmin V Voicu

Alexandru Alvin Stänescu

Artificial intelligence (AI) agents for user interface (UI) automation to application programming interface (API) automation, and vice versa, are disclosed. The operations performed by a UI automation on the back-end can be captured by an AI agent, including what communications are sent and the context thereof. A robotic process automation (RPA) activity can then be built in an RPA workflow that replaces the UI automation with an API automation. Alternatively, an API automation is replaced with a UI automation. The AI agent employs a fine-tuned generative AI model to understand the context of the communications. The AI agent may also find obsolete duplicates of UI automations and replace these with API automations, or vice versa.

Artificial intelligence agents for user interface automation to application programming interface automation and vice versa

Automatic anchor determination for target graphical element identification in user interface (UI) automation is disclosed. A context-based mechanism assists in discriminating between duplicate target UI element candidates. More specifically, additional anchors may be determined and automatically added for a target UI element that provide context and are visible in an area surrounding the target. During design time, a target UI element may be indicated by a user of a designer application and a corresponding anchor may be determined. When a pair of UI elements is found having the same or similar characteristics and/or relationships to the target-anchor pair, an additional anchor is automatically identified without requesting user input. The additional anchor may be selected from the UI elements within a radius of the target UI element.

Growing community of inventors

Alexandria, VA, United States of America

Michael Aristo Leonard, Ii