The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Sep. 30, 2025
Filed:
Mar. 08, 2023
Sap SE, Walldorf, DE;
Louis Rakotoarivony, Verrières-le-Buisson, FR;
Xiaohui Xue, Courbevoie, FR;
SAP SE, Walldorf, DE;
Abstract
Automation of robotic process automation design may be improved by integrating machine learning. A screenshot of a user interface of an application to be automated is captured. Then a selection of an area of the screenshot is determined. The area is provided as input to a document information extraction machine learning model configured to output labels and coordinates for user interface elements in the area. Labels for respective user interface elements of the one or more user interface elements and a respective set of coordinates are identified for each of the user interface elements. The user interface elements and respective criteria are declared as robotic process automation entities in a robotic process automation object model. Actions are assigned to the robotic process automation elements. And then the actions are performed on the application to be automated based on the respective criteria for the robotic process automation elements.