| Naslov: | A comprehensive user-centric method for evaluating and comparing XAI explanations |
|---|
| Avtorji: | ID Brdnik, Saša (Avtor)
ID Karakatič, Sašo (Avtor)
ID Šumak, Boštjan (Avtor) |
|---|
| Datoteke: |  A_Comprehensive_User-Centric_Method_for_Evaluating_and_Comparing_XAI_Explanations.pdf (3,78 MB)
MD5: C42BEFA2F6ECA8ED1AF28605F9B5AD1E
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | Evaluation and selection of explanations in explainable artificial intelligence (XAI) is essential as AI systems grow, increasing transparency needs. Existing methods rarely built on theoretical grounding and failed to distinguish perceived and actual user understanding. This paper proposes a comprehensive user evaluation method for XAI explanations in a structured questionnaire format, enabling efficient data collection and comparison. Core explanation dimensions recognized in literature were integrated into our method: trust, satisfaction, mental models, and mental effort. Reliable instruments analyzed with exploratory factor analysis were used to assess trust and satisfaction. Mental models were assessed through reflection, prediction, and glitch detection tasks. Ten XAI techniques were evaluated: image-based (LIME positive and negative masking, feature occlusion, saliency maps, SHAP, LIME overlay mask) and numeric-based (SHAP bar chart, partial dependence plots, decision tree, counterfactual explanations, ANCHOR). Our method effectively differentiates explanations across multiple dimensions, aiding the selection of the most suitable technique for end-users. |
|---|
| Ključne besede: | user-centered XAI evaluation, XAI evaluation, user evaluation method, explainable artificial intelligence |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 21.06.2024 |
|---|
| Datum sprejetja članka: | 05.02.2025 |
|---|
| Datum objave: | 12.03.2025 |
|---|
| Založnik: | Taylor & Francis |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | 4 str. |
|---|
| PID: | 20.500.12556/DKUM-97982  |
|---|
| UDK: | 004.8 |
|---|
| COBISS.SI-ID: | 228953347 |
|---|
| DOI: | 10.1080/10447318.2025.2470278 |
|---|
| ISSN pri članku: | 1532-7590 |
|---|
| Datum objave v DKUM: | 06.05.2026 |
|---|
| Število ogledov: | 161 |
|---|
| Število prenosov: | 60 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
