20.500.12556/DKUM-97982 A comprehensive user-centric method for evaluating and comparing XAI explanations Evaluation and selection of explanations in explainable artificial intelligence (XAI) is essential as AI systems grow, increasing transparency needs. Existing methods rarely built on theoretical grounding and failed to distinguish perceived and actual user understanding. This paper proposes a comprehensive user evaluation method for XAI explanations in a structured questionnaire format, enabling efficient data collection and comparison. Core explanation dimensions recognized in literature were integrated into our method: trust, satisfaction, mental models, and mental effort. Reliable instruments analyzed with exploratory factor analysis were used to assess trust and satisfaction. Mental models were assessed through reflection, prediction, and glitch detection tasks. Ten XAI techniques were evaluated: image-based (LIME positive and negative masking, feature occlusion, saliency maps, SHAP, LIME overlay mask) and numeric-based (SHAP bar chart, partial dependence plots, decision tree, counterfactual explanations, ANCHOR). Our method effectively differentiates explanations across multiple dimensions, aiding the selection of the most suitable technique for end-users. user-centered XAI evaluation XAI evaluation user evaluation method explainable artificial intelligence umetna inteligenca ocena uporabnika ocenjevanje true false true Taylor & Francis Angleški jezik Slovenski jezik https://www.tandfonline.com/journals/hihc20 Članek v reviji 2026-05-06 14:56:10 2026-05-06 14:56:11 2026-05-07 03:10:31 0000-00-00 00:00:00 2025 0 0 4 str. Published online: 12 Mar 2025 0000-00-00 Zaloznikova Objavljeno NiDoloceno 2024-06-21 2025-02-05 2025-03-12 004.8 228953347 10.1080/10447318.2025.2470278 1532-7590 A_Comprehensive_User-Centric_Method_for_Evaluating_and_Comparing_XAI_Explanations.pdf A_Comprehensive_User-Centric_Method_for_Evaluating_and_Comparing_XAI_Explanations.pdf 1 C42BEFA2F6ECA8ED1AF28605F9B5AD1E 13f2f96448766322b7002ab8de8735a5db53d39c3165029b948ed3a67999eb3c 6f7ccb71-494e-11f1-baa1-00155d0001a1 https://dk.um.si/Dokument.php?lang=slv&id=205824 Fakulteta za elektrotehniko, računalništvo in informatiko 0 0 0