Entit Software LLC

Hewlett-packard Development Company, L.p.

Yonathan Livny

Ruth Bergman

Omer Barkol

Sagi Schein

Dror Saaroni

David Lehavi

Dor Nir

Mordechai Lanzkron

Ayelel Pnueli

Rotem Bentzur

Marina Gammer

In one implementation, an image-based application automation system determines that a first image from a plurality of images associated with an input event does not satisfy any portion of a graphical user interface at a first time. The image-based application automation system then selects, independent of user input, a second image from the plurality of images after the first time, and identifies a portion of the graphical user interface satisfied by the second image.

Image-based application automation

In one implementation, an image-based automation process includes identifying a graphical object of a graphical user interface and performing an action relative to the graphical object at the graphical user interface. The identifying is based on an image including the graphical object.

Image-based automation systems and methods

A mechanism is disclosed for identifying non-standard user interface controls in a target application. The mechanism includes an accelerator, an agent, and a dialog. The agent is configured to be installed into the target application and to interface with the accelerator. The dialog is configured to select non-standard controls in the target application where each non-standard control includes a set of properties. The agent is configured to provide the properties of the selected non-standard controls to the accelerator. The accelerator is configured to determine a set of common properties for the selected non-standard controls and to automatically generate an identification rule for the determined set of common properties.

Identification of user interface controls

Growing community of inventors

Yehud, Israel

Yonathan Livny