The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Dec. 13, 2022
Filed:
Dec. 23, 2019
Johnson Controls Tyco Ip Holdings Llp, Milwaukee, WI (US);
Young M. Lee, Old Westbury, NY (US);
Zhanhong Jiang, Milwaukee, WI (US);
Viswanath Ramamurti, San Leandro, CA (US);
Sugumar Murugesan, Santa Clara, CA (US);
Kirk H. Drees, Cedarburg, WI (US);
Michael James Risbeck, Madison, WI (US);
JOHNSON CONTROLS TYCO IP HOLDINGS LLP, Milwaukee, WI (US);
Abstract
Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.