The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Oct. 27, 2026

Filed:

Jul. 01, 2024
Applicant:

Autodesk, Inc., San Francisco, CA (US);

Inventors:

Yuan Zhou, Waterloo, CA;

Shu Wang, Hamilton, CA;

Harsh Bakulchandra Patel, Etobicoke, CA;

Michael Pennell, San Clemente, CA (US);

Jieliang Luo, San Bruno, CA (US);

Alexander Lamb, Lake Forest, CA (US);

Assignee:

AUTODESK, INC., San Francisco, CA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G05B 13/02 (2006.01); G05B 13/04 (2006.01);
U.S. Cl.
CPC ...
G05B 13/0265 (2013.01); G05B 13/04 (2013.01);
Abstract

A method and system control a water distribution network. A database is maintained of prior states based on a residential water demand, a tank level, and an energy tariff. A current state of the water distribution network is determined. Rewards are determined and include a tank level constraint, an energy cost, and a toggle count. A query based model is used to determine a set of control points used to control a first prior state. An RL agent is trained based on the prior states and rewards. The RL agent determines a control setpoint (that changes the pump speed) that maintains the tank level, minimizes the energy cost, and complies with the toggle count. The RL agent determines time slots and selects one of the time slots. Hybrid setpoints are generated to control the water distribution network within the selected time slot.


Find Patent Forward Citations

Quick Actions:

Zhou, Yuan. (2026). Hybrid reinforcement learning (rl) to control a water distribution network (U.S. Patent No. 12775248). U.S. Patent and Trademark Office. https://idiyas.com/patent/badge/12775248

Data source: USPTO (United States Patent and Trademark Office) public patent records. Weekly synchronization. How IDiyas builds this profile

Loading…