The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 09, 2021
Filed:
Dec. 13, 2018
Exxonmobil Research and Engineering Company, Annandale, NJ (US);
Thomas A. Badgwell, Clinton, NJ (US);
Kuang-Hung Liu, Basking Ridge, NJ (US);
Niranjan A. Subrahmanya, Jersey City, NJ (US);
Wei D. Liu, Schenectady, NY (US);
Michael H. Kovalski, Summit, NJ (US);
ExxonMobil Research and Engineering Company, Annandale, NJ (US);
Abstract
Systems and methods are provided for using a Deep Reinforcement Learning (DRL) agent to provide adaptive tuning of process controllers, such as Proportional-Integral-Derivative (PID) controllers. The agent can monitor process controller performance, and if unsatisfactory, can attempt to improve it by making incremental changes to the tuning parameters for the process controller. The effect of a tuning change can then be observed by the agent and used to update the agent's process controller tuning policy. It has been unexpectedly discovered that providing adaptive tuning based on incremental changes in tuning parameters, as opposed to making changes independent of current values of the tuning parameters, can provide enhanced or improved control over a controlled variable of a process.