| Naslov: | An improved deep reinforcement learning approach: a case study for optimisation of berth and yard scheduling for bulk cargo terminal |
|---|
| Avtorji: | ID Ai, T. (Avtor)
ID Huang, L. (Avtor)
ID Song, R. J. (Avtor)
ID Huang, H. F. (Avtor)
ID Jiao, F. (Avtor)
ID Ma, W. G. (Avtor) |
|---|
| Datoteke: |  APEM18-3_303-316.pdf (1019,21 KB)
MD5: F039E9B5EAEC22F6F2A834E5A9BC62A7
 https://apem-journal.org/Archives/2023/APEM18-3_303-316.pdf
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FS - Fakulteta za strojništvo
|
|---|
| Opis: | The cornerstone of port production operations is ship handling, necessitating judicious allocation of diverse production resources to enhance the efficiency of loading and unloading operations. This paper introduces an optimisation method based on deep reinforcement learning to schedule berths and yards at a bulk cargo terminal. A Markov Decision Process model is formulated by analysing scheduling processes and unloading operations in bulk port imports business. The study presents an enhanced reinforcement learning algorithm called PS-D3QN (Prioritised Experience Replay and Softmax strategy-based Dueling Double Deep Q-Network), amalgamating the strengths of the Double DQN and Dueling DQN algorithms. The proposed solution is evaluated using actual port data and benchmarked against the other two algorithms mentioned in this paper. The numerical experiments and comparative analysis substantiate that the PS-D3QN algorithm significantly enhances the efficiency of berth and yard scheduling in bulk terminals, reduces the cost of port operation, and eliminates errors associated with manual scheduling. The algorithm presented in this paper can be tailored to address scheduling issues in the fields of production and manufacturing with suitable adjustments, including problems like the job shop scheduling problem and its extensions. |
|---|
| Ključne besede: | bulk cargo terminal, scheduling, optimisation, Markov decision process (MDP) model, deep reinforcement learning, prioritised experience replay and softmax strategy-based dueling, double deep Q-network |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 22.08.2023 |
|---|
| Datum sprejetja članka: | 07.11.2023 |
|---|
| Datum objave: | 19.11.2023 |
|---|
| Založnik: | Chair of Production Engineering (CPE), University of Maribor Faculty of Mechanical Engineering |
|---|
| Leto izida: | 2023 |
|---|
| Št. strani: | str. 303-316 |
|---|
| Številčenje: | Vol. 18, no. 3 |
|---|
| PID: | 20.500.12556/DKUM-97086  |
|---|
| UDK: | 626/627.093:004.85 |
|---|
| COBISS.SI-ID: | 268736003 |
|---|
| DOI: | 10.14743/apem2023.3.474 |
|---|
| ISSN pri članku: | 1854-6250 |
|---|
| Avtorske pravice: | Content from this work may be used under the terms of the Creative Commons Attribution 4.0 International Licence (CC BY 4.0). Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI. |
|---|
| Datum objave v DKUM: | 17.02.2026 |
|---|
| Število ogledov: | 321 |
|---|
| Število prenosov: | 3 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
