The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Feb. 07, 2023
Filed:
Dec. 23, 2019
Johnson Controls Tyco Ip Holdings Llp, Milwaukee, WI (US);
Young M. Lee, Old Westbury, NY (US);
Zhanhong Jiang, Milwaukee, WI (US);
Viswanath Ramamurti, San Leandro, CA (US);
Sugumar Murugesan, Santa Clara, CA (US);
Kirk H. Drees, Cedarburg, WI (US);
Michael James Risbeck, Madison, WI (US);
JOHNSON CONTROLS TYCO IP HOLDINGS LLP, Milwaukee, WI (US);
Abstract
Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.