logo

For the Inventor, By the Inventor

The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Patent No.:

US 12585862 B1

PDFFull Text
Date of Patent:
Mar. 24, 2026

Filed:

Oct. 08, 2024

Training data for training artificial intelligence agents to automate multimodal software usage

Applicant:

Anthropic, Pbc, San Francisco, CA (US);

Inventors:

Sagnak Tasirlar, San Francisco, CA (US);

David Abrahams, San Francisco, CA (US);

Lina Lukyantseva, San Francisco, CA (US);

Erich Elsen, San Francisco, CA (US);

Maxwell Nye, San Francisco, CA (US);

Augustus Odena, San Francisco, CA (US);

Rohan Bavishi, San Francisco, CA (US);

Vibhaa Sivaraman, San Francisco, CA (US);

Adam Hoff, San Francisco, CA (US);

Teddy Rothschild, San Francisco, CA (US);

Shaya Zarkesh, San Francisco, CA (US);

Deepak Moparthi, San Francisco, CA (US);

Jacob Van Gogh, San Francisco, CA (US);

Claire Pajot, San Francisco, CA (US);

Curtis Hawthorne, San Francisco, CA (US);

Matt Elkherj, San Francisco, CA (US);

Warut Vijitbenjaronk, San Francisco, CA (US);

Arushi Somani, San Francisco, CA (US);

Johnny Lee, San Francisco, CA (US);

Joe Gershenson, San Francisco, CA (US);

Jordyn Shuell, San Francisco, CA (US);

Danielle Perszyk, San Francisco, CA (US);

Assignee:

Anthropic, PBC, San Francisco, CA (US);

Attorney:

Haynes and Boone, LLP

Primary Examiner:

Sean M Conner

Int. Cl.
CPC ...
G06V 10/82 (2022.01); G06F 3/0481 (2022.01); G06F 3/0484 (2022.01); G06F 16/951 (2019.01); G06F 40/166 (2020.01); G06F 40/174 (2020.01); G06F 40/284 (2020.01); G06N 3/0455 (2023.01); G06N 3/091 (2023.01); G06N 5/04 (2023.01); G06N 20/00 (2019.01); G06V 10/77 (2022.01); G06V 10/774 (2022.01); G06V 10/80 (2022.01); G06V 20/40 (2022.01); G06V 30/19 (2022.01); G06V 30/41 (2022.01); G06F 9/451 (2018.01);
U.S. Cl.
CPC ...
G06F 40/166 (2020.01); G06F 3/0481 (2013.01); G06F 3/0484 (2013.01); G06F 16/951 (2019.01); G06F 40/174 (2020.01); G06F 40/284 (2020.01); G06N 3/0455 (2023.01); G06N 3/091 (2023.01); G06N 5/04 (2013.01); G06N 20/00 (2019.01); G06V 10/7715 (2022.01); G06V 10/774 (2022.01); G06V 10/803 (2022.01); G06V 10/82 (2022.01); G06V 20/40 (2022.01); G06V 30/19147 (2022.01); G06V 30/41 (2022.01); G06F 9/451 (2018.02);
Abstract

A system for automating software usage includes an agent configured to automate. The agent is trained on one or more training data sets. The one or more training datasets include one or more of a first training dataset including documents containing text interleaved with images, a second training dataset including text embedded in images, a third training dataset including recorded videos of software usage, a fourth training dataset including portable document format (PDF) documents, a fifth training dataset including recorded videos of software tool usage trajectories, a sixth training dataset including images of open-domain web pages, a seventh training dataset including images of specific-domain web pages, and/or an eighth training dataset including images of agentic trajectories of the agent performing interface automation task workflows.

Find Patent Forward Citations

Tasirlar, Sagnak. (2026). Training data for training artificial intelligence agents to automate multimodal software usage (U.S. Patent No. 12585862). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12585862

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…