Sap Se

Satyadeep Dey

Mithilesh Kumar Singh

Suvajit Dutta

Sudha Karanam Narasimha Murthy

Sharmika Parmar

Chandrakanth S

Vinay Kumar

Raghavendra D

Philippe Long

Gagan K

Anubhav Sadana

Deepak Pandian

Provided are systems and methods for batching instructions of a bot during execution/runtime of the bot. The bot may be a software program that is designed to perform user interface interactions (e.g., button clicks, opening/closing pages, text entry, etc.) in place of a human. In one example, a method may include receiving a request to execute a bot program configured to perform a sequence of actions on a user interface of a software application, identifying a plurality of actions of the bot program that can be batched, assembling a plurality of instructions for performing the plurality of actions of the bot program into a batched payload, and transmitting an automation request with the batched payload to a back-end of the application on a server.

Batch processing during bot runtime

Provided are systems and methods for automatically detecting a change in screen content and generating a hint message in response. As another example, the system may auto-capture the detected change in the screen content instead of or in addition to the hint message. In one example, a method may include capturing user interface metadata of content being displayed by a client-side of the software application, activating a recorder that is configured to record events transmitted between the client-side and a server-side of the software application, receiving updated user interface metadata based on a user interaction on the client-side of the software application, determining that user interface content has changed based on a comparison of the captured user interface metadata to the updated user interface metadata, and displaying a hint message via the user interface of the client-side of the software application.

Screen capture hint and automated screen capture

Disclosed herein are system, method, and computer program product embodiments for surface automation in black box environments. An embodiment operates by determining scenarios of an application for automation; detecting the scenario during an execution of an application; capturing and storing one or more user interface screenshots of the scenario; identifying and storing user interface information from the user interface screenshot; implementing a sequential set of instructions comprising at least one textual element detection technique and at least one non-textual element detection technique; and executing the sequential set of instructions.

Surface automation in black box environments

Provided are systems and methods for converting user interface events that occur in a software application developed via a WebGUI framework into activity descriptions and into a bot software program. In one example, a method may include recording events transmitted between a user interface of a web application open within a web browser on a client device and a back-end of the web application on a server, identifying codes associated with user interface elements which are assigned to the recorded events, converting the identified codes assigned to the recorded events into a human-readable descriptions of the recorded events based on a predefined mapping between the codes and the human-readable descriptions stored in the predefined mapping, and displaying the human-readable descriptions of the recorded events based on the identified order among the recorded events.

Conversion of user interface events

Growing community of inventors

Bengaluru, India

Satyadeep Dey