| Title: | Performance comparison of single-objective evolutionary algorithms implemented in different frameworks |
|---|
| Authors: | ID Ravber, Miha (Author)
ID Šmid, Marko (Author)
ID Moravec, Matej (Author)
ID Mernik, Marjan (Author)
ID Črepinšek, Matej (Author) |
|---|
| Files: |  infor603_(1).pdf (3,89 MB)
MD5: 9B13796479082B7D3EF92245A384E3DB
|
|---|
| Language: | English |
|---|
| Work type: | Article |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: | FERI - Faculty of Electrical Engineering and Computer Science
|
|---|
| Abstract: | Fair comparison with state-of-the-art evolutionary algorithms is crucial, but is obstructed by differences in problems, parameters, and stopping criteria across studies. Metaheuristic frameworks can help, but often lack clarity on algorithm versions, improvements, or deviations. Some also restrict parameter configuration. We analysed source codes and identified inconsistencies between implementations. Performance comparisons across frameworks, even with identical settings, revealed significant differences, sometimes even with the authors’ own code. This questions the validity of comparisons using such frameworks. We provide guidelines to improve open-source metaheuristics, aiming to support more credible and reliable comparative studies. |
|---|
| Keywords: | metaheuristics, evolutionary algorithm, metaheuristic optimization framework, algorithm comparison, benchmarking |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Submitted for review: | 01.12.2024 |
|---|
| Article acceptance date: | 01.09.2025 |
|---|
| Publication date: | 16.09.2025 |
|---|
| Publisher: | Informatica |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | str. 677-712 |
|---|
| Numbering: | Vol. 36, iss. 3 |
|---|
| PID: | 20.500.12556/DKUM-95631  |
|---|
| UDC: | 004.45 |
|---|
| ISSN on article: | 1822-8844 |
|---|
| COBISS.SI-ID: | 250119171 |
|---|
| DOI: | 10.15388/25-INFOR603 |
|---|
| Publication date in DKUM: | 02.10.2025 |
|---|
| Views: | 219 |
|---|
| Downloads: | 8 |
|---|
| Metadata: |    |
|---|
| Categories: | Misc.
|
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
