International Business Machines Corporation

Lu Chen

Jin Shi

Ting Ting Wu

Hai Dong Zhang

Ping Yang

Ke Gong

Rui Na Liu

Tang Xue Bo

Meng Qi Chen

Disclosed are techniques for automated locating of user interface elements during graphical user interface testing. When a graphical user interface (GUI) is received for testing, images of the GUI are inputted to a machine learning algorithm, where image processing techniques are applied to identify groups of user interface elements and their constituent elements. Multi-dimensional index values are assigned to groups and elements corresponding to their positions within the GUI. Automated testing of the user interface elements of the GUI is performed by locating the user interface elements by their index values. If an element is not found, a scrolling technique is applied to generate an expanded virtual GUI of one or more groups of user interface elements, and the machine learning algorithm refreshes the index values using the expanded virtual GUI.

Automated locating of GUI elements during testing using multidimensional indices

A computer-implemented method is disclosed. In the method, a start position of an item list comprising a plurality of items is determined in response to a session-in event. An end position of the item list is determined in response to a session-out event. The reviewed sub-list and unreviewed sub-list are differently displayed. The reviewed sub-list is at least a part of the item list and comprises items from the start position to the end position in the item list. The unreviewed sub-list comprises items outside the reviewed sub-list.

Recognition and display of reading progress

Growing community of inventors

Ningbo, China

Lu Chen