logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 9189254 B1

PDFFull Text
Date of Patent:
Nov. 17, 2015

Filed:

Oct. 01, 2010

Translating text to, merging, and optimizing graphical user interface tasks

Applicants:

Nathaniel Kushman, Boston, MA (US);

Regina Barzilay, Cambridge, MA (US);

Satchuthananthavale R. Kuhan Branavan, Cambridge, MA (US);

Dina Katabi, Cambridge, MA (US);

Martin C. Rinard, Arlington, MA (US);

Inventors:

Nathaniel Kushman, Boston, MA (US);

Regina Barzilay, Cambridge, MA (US);

Satchuthananthavale R. Kuhan Branavan, Cambridge, MA (US);

Dina Katabi, Cambridge, MA (US);

Martin C. Rinard, Arlington, MA (US);

Assignee:

Massachusetts Institute of Technology, Cambridge, MA (US);

Attorney:

Nields, Lemack & Frame, LLC

Primary Examiner:

Amy Ng

Assistant Examiner:

Toan Vu

Int. Cl.
CPC ...
G06F 3/01 (2006.01); G06F 9/44 (2006.01); G06F 3/00 (2006.01); G06F 3/0481 (2013.01); G06F 11/34 (2006.01);
U.S. Cl.
CPC ...
G06F 9/4446 (2013.01); G06F 3/0481 (2013.01); G06F 11/3438 (2013.01); G06F 2201/865 (2013.01);
Abstract

A system and method that enables a plurality of lay users to collaborate on automating computer tasks is disclosed. In one embodiment, the system automatically performs these tasks, rather than just documenting how to perform them. The system allows a database of solutions to be built for every important computer task. A key characteristic of this system is that users contribute to this database by simply performing the task. The system records the graphical user interface (GUI) actions as the user performs the task. It aggregates GUI traces from multiple users into a canonical sequence of GUI actions parameterized by user-environment that will successfully accomplish the task on a variety of different configurations. A classifier is used to predict which steps are likely to be misinterpreted and requests human intervention to properly perform them. This process can be done iteratively until the translation is believed to be correct.

Find Patent Forward Citations

Kushman, Nathaniel. (2015). Translating text to, merging, and optimizing graphical user interface tasks (U.S. Patent No. 9189254). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/9189254

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…