| Naslov: | Cascade hydropower plant operational dispatch control using deep reinforcement learning on a digital twin environment |
|---|
| Avtorji: | ID Rot Weiss, Erik (Avtor)
ID Gselman, Robert (Avtor)
ID Polner, Rudi (Avtor)
ID Šafarič, Riko (Avtor) |
|---|
| Datoteke: |  energies-18-04660-v2.pdf (6,94 MB)
MD5: 256C79F8E5B44F016FD851167639CA78
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | In this work, we propose the use of a reinforcement learning (RL) agent for the control of a cascade hydropower plant system. Generally, this job is handled by power plant dispatchers who manually adjust power plant electricity production to meet the changing demand set by energy traders. This work explores the more fundamental problem with the cascade hydropower plant operation of flow control for power production in a highly nonlinear setting on a data-based digital twin. Using deep deterministic policy gradient (DDPG), twin delayed DDPG (TD3), soft actor-critic (SAC), and proximal policy optimization (PPO) algorithms, we can generalize the characteristics of the system and determine the human dispatcher level of control of the entire system of eight hydropower plants on the river Drava in Slovenia. The creation of an RL agent that makes decisions similar to a human dispatcher is not only interesting in terms of control but also in terms of long-term decision-making analysis in an ever-changing energy portfolio. The specific novelty of this work is in training an RL agent on an accurate testing environment of eight real-world cascade hydropower plants on the river Drava in Slovenia and comparing the agent’s performance to human dispatchers. The results show that the RL agent’s absolute mean error of 7.64 MW is comparable to the general human dispatcher’s absolute mean error of 5.8 MW at a peak installed power of 591.95 MW. |
|---|
| Ključne besede: | cascade hydropower, reinforcement learning, digital twin |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 08.07.2025 |
|---|
| Datum sprejetja članka: | 27.08.2025 |
|---|
| Datum objave: | 02.09.2025 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | 30 str. |
|---|
| Številčenje: | Vol. 18, issue 17, [article no.] 4660 |
|---|
| PID: | 20.500.12556/DKUM-95741  |
|---|
| UDK: | 621.3 |
|---|
| COBISS.SI-ID: | 253594627 |
|---|
| DOI: | 10.3390/en18174660 |
|---|
| ISSN pri članku: | 1996-1073 |
|---|
| Avtorske pravice: | © 2025 by the authors |
|---|
| Datum objave v DKUM: | 17.10.2025 |
|---|
| Število ogledov: | 289 |
|---|
| Število prenosov: | 10 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
