| Title: | Cascade hydropower plant operational dispatch control using deep reinforcement learning on a digital twin environment |
|---|
| Authors: | ID Rot Weiss, Erik (Author)
ID Gselman, Robert (Author)
ID Polner, Rudi (Author)
ID Šafarič, Riko (Author) |
|---|
| Files: |  energies-18-04660-v2.pdf (6,94 MB)
MD5: 256C79F8E5B44F016FD851167639CA78
|
|---|
| Language: | English |
|---|
| Work type: | Article |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: | FERI - Faculty of Electrical Engineering and Computer Science
|
|---|
| Abstract: | In this work, we propose the use of a reinforcement learning (RL) agent for the control of a cascade hydropower plant system. Generally, this job is handled by power plant dispatchers who manually adjust power plant electricity production to meet the changing demand set by energy traders. This work explores the more fundamental problem with the cascade hydropower plant operation of flow control for power production in a highly nonlinear setting on a data-based digital twin. Using deep deterministic policy gradient (DDPG), twin delayed DDPG (TD3), soft actor-critic (SAC), and proximal policy optimization (PPO) algorithms, we can generalize the characteristics of the system and determine the human dispatcher level of control of the entire system of eight hydropower plants on the river Drava in Slovenia. The creation of an RL agent that makes decisions similar to a human dispatcher is not only interesting in terms of control but also in terms of long-term decision-making analysis in an ever-changing energy portfolio. The specific novelty of this work is in training an RL agent on an accurate testing environment of eight real-world cascade hydropower plants on the river Drava in Slovenia and comparing the agent’s performance to human dispatchers. The results show that the RL agent’s absolute mean error of 7.64 MW is comparable to the general human dispatcher’s absolute mean error of 5.8 MW at a peak installed power of 591.95 MW. |
|---|
| Keywords: | cascade hydropower, reinforcement learning, digital twin |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Submitted for review: | 08.07.2025 |
|---|
| Article acceptance date: | 27.08.2025 |
|---|
| Publication date: | 02.09.2025 |
|---|
| Publisher: | MDPI |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | 30 str. |
|---|
| Numbering: | Vol. 18, issue 17, [article no.] 4660 |
|---|
| PID: | 20.500.12556/DKUM-95741  |
|---|
| UDC: | 621.3 |
|---|
| ISSN on article: | 1996-1073 |
|---|
| COBISS.SI-ID: | 253594627 |
|---|
| DOI: | 10.3390/en18174660 |
|---|
| Copyright: | © 2025 by the authors |
|---|
| Publication date in DKUM: | 17.10.2025 |
|---|
| Views: | 285 |
|---|
| Downloads: | 10 |
|---|
| Metadata: |    |
|---|
| Categories: | Misc.
|
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
