The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Jul. 25, 2023

Filed:

Feb. 12, 2018
Applicant:

Adobe Inc., San Jose, CA (US);

Inventors:

Haoxiang Li, San Jose, CA (US);

Yinan Zhang, West Lebanon, NH (US);

Assignee:

ADOBE INC., San Jose, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G05B 13/02 (2006.01); G05B 17/02 (2006.01); G06N 3/08 (2023.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G05B 13/027 (2013.01); G05B 17/02 (2013.01); G06N 3/08 (2013.01); G06N 20/00 (2019.01);
Abstract

The training of a learning agent to provide real-time control of an object is disclosed. Training of the learning agent and training of a corresponding pioneer agent are iteratively alternated. The training of the learning and pioneer agents is under the supervision of a supervisor agent. The training of the learning agent provides feedback for subsequent training of the pioneer agent. The training of the pioneer agent provides feedback for subsequent training of the learning agent. During the training, a supervisor coefficient modulates the influence of the supervisor agent. As agents are trained, the influence of the supervisor agent is decayed. The training of the learning agent, under a first level of supervisor influence, includes real-time control of the object. The subsequent training of the pioneer agent, under a reduced level of supervisor influence, includes replay of training data accumulated during the real-time control of the object.


Find Patent Forward Citations

Li, Haoxiang. (2023). Safe and efficient training of a control agent (U.S. Patent No. 11709462). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/11709462

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…