The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Sep. 13, 2022

Filed:

Sep. 21, 2020
Applicant:

Tsinghua University, Beijing, CN;

Inventors:

Wenchuan Wu, Beijing, CN;

Haotian Liu, Beijing, CN;

Hongbin Sun, Beijing, CN;

Bin Wang, Beijing, CN;

Qinglai Guo, Beijing, CN;

Tian Xia, Beijing, CN;

Assignee:

TSINGHUA UNIVERSITY, Beijing, CN;

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G05B 19/00 (2006.01); G05B 19/042 (2006.01); G06N 20/00 (2019.01);
U.S. Cl.
CPC ...
G05B 19/042 (2013.01); G06N 20/00 (2019.01); G05B 2219/2639 (2013.01);
Abstract

A power grid reactive voltage control method and control system based on two-stage deep reinforcement learning, comprising steps of: building interactive training environment based on Markov decision process, according to a regional power grid simulation model and a reactive voltage optimization model; training a reactive voltage control model offline by using a SAC algorithm, in the interactive training environment based on Markov decision process; deploying the reactive voltage control model to a regional power grid online system; and acquiring operating state information of the regional power grid, updating the reactive voltage control model, and generating an optimal reactive voltage control policy. As compared with the existing power grid optimizing method based on reinforcement learning, the online control training according to the present disclosure has costs and safety hazards greatly reduced, and is more suitable for deployment in an actual power system.


Find Patent Forward Citations

Loading…