20.500.12556/DKUM-92741 A brief review on benchmarking for large language models evaluation in healthcare This paper reviews benchmarking methods for evaluating large language models (LLMs) in healthcare settings. It highlights the importance of rigorous benchmarking to ensure LLMs' safety, accuracy, and effectiveness in clinical applications. The review also discusses the challenges of developing standardized benchmarks and metrics tailored to healthcare-specific tasks such as medical text generation, disease diagnosis, and patient management. Ethical considerations, including privacy, data security, and bias, are also addressed, underscoring the need for multidisciplinary collaboration to establish robust benchmarking frameworks that facilitate LLMs' reliable and ethical use in healthcare. Evaluation of LLMs remains challenging due to the lack of standardized healthcare-specific benchmarks and comprehensive datasets. Key concerns include patient safety, data privacy, model bias, and better explainability, all of which impact the overall trustworthiness of LLMs in clinical settings. artificial intelligence benchmarking chatbots healthcare large language models natural language processing umetna inteligenca primerjalna analiza zdravstvena oskrba veliki jezikovni modeli obdelava naravnega jezika true false true Wiley Angleški jezik Slovenski jezik Znanstveno delo 2025-05-09 03:09:26 2025-05-12 11:15:27 2025-11-13 11:53:07 0000-00-00 00:00:00 2025 0 0 str. 1-16 išt. 2, št. članka e70010 Letn. 15 2025 0000-00-00 Zaloznikova Objavljeno NiDoloceno 2025-02-17 2025-03-11 2025-01-01 004.89:614 234990851 10.1002/widm.70010 1942-4795 https://wires.onlinelibrary.wiley.com/doi/10.1002/widm.70010 1 40d0f5aa-2c72-11f0-acfb-00155d000105 https://dk.um.si/Dokument.php?lang=slv&id=190828 WIREs-Data-Min-Knowl---2025---Budler---A-Brief-Review-on-Ben.pdf WIREs-Data-Min-Knowl---2025---Budler---A-Brief-Review-on-Ben.pdf 1 132DFD2ED2C2E99251CEF9B5CEE42FF8 1b8eb4dfd23ba21b5133af8bc613ef2ae8b361d441e501caa8b6fb4da9a38573 4ce25acb-6093-11f0-a62e-00155d000105 https://dk.um.si/Dokument.php?lang=slv&id=193556 Fakulteta za zdravstvene vede Fakulteta za elektrotehniko, računalništvo in informatiko 0 0 0