T-mobile Usa, Inc.

Anqi Luo

Pei Zheng

Tor Fredericks

Dong Chen

Described herein are techniques that may be used to automate testing of services on mobile devices using visual analysis. In some embodiments, a machine learning model is trained using interaction data received from a number of mobile devices by correlating user selections with visual elements (e.g., icons). During execution of a testing routine on a mobile device, screenshots are obtained of a screen of the mobile device and provided to the machine learning model. An action is generated based on the provided screenshot that simulates a user action (e.g., a user touch on the screen of the mobile device) at a location of an icon or other visual element associated with the testing routine. These steps are repeated until an end-state of the testing routine is detected.

Growing community of inventors

Redmond, WA, United States of America

Anqi Luo