| Naslov: | Ensemble-based knowledge distillation for identification of childhood pneumonia |
|---|
| Avtorji: | ID Vrbančič, Grega (Avtor)
ID Podgorelec, Vili (Avtor) |
|---|
| Datoteke: |  electronics-14-03115.pdf (915,47 KB)
MD5: 9C1E2F1449121390503F2B2AA8CE2C30
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | Childhood pneumonia remains a key cause of global morbidity and mortality, highlighting the need for accurate and efficient diagnostic tools. Ensemble methods have proven to be among the most successful approaches for identifying childhood pneumonia from chest X-ray images. However, deploying large, complex convolutional neural network models in resource-constrained environments presents challenges due to their high computational demands. Therefore, we propose a novel ensemble-based knowledge distillation method for identifying childhood pneumonia from X-ray images, which utilizes an ensemble of classification models to distill the knowledge to a more efficient student model. Experiments conducted on a chest X-ray dataset show that the distilled student model achieves comparable (statistically not significantly different) predictive performance to that of the Stochastic Gradient with Warm Restarts ensemble method (F1-score on average 0.95 vs. 0.96, respectively), while significantly reducing inference time and decreasing FLOPs by a factor of 6.5. Based on the obtained results, the proposed method highlights the potential of knowledge distillation to enhance the efficiency of complex methods, making them more suitable for utilization in environments with limited computational resources. |
|---|
| Ključne besede: | knowledge distillation, convolutional neural networks, childhood pneumonia |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 26.05.2025 |
|---|
| Datum sprejetja članka: | 03.08.2025 |
|---|
| Datum objave: | 05.08.2025 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | 21 str. |
|---|
| Številčenje: | Vol. 14, iss. 15, [art. no.] 3115 |
|---|
| PID: | 20.500.12556/DKUM-94527  |
|---|
| UDK: | 004.9 |
|---|
| COBISS.SI-ID: | 246010371 |
|---|
| DOI: | 10.3390/electronics14153115 |
|---|
| ISSN pri članku: | 2079-9292 |
|---|
| Avtorske pravice: | © 2025 by the authors |
|---|
| Datum objave v DKUM: | 20.08.2025 |
|---|
| Število ogledov: | 139 |
|---|
| Število prenosov: | 9 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
