| Naslov: | A brief review on benchmarking for large language models evaluation in healthcare |
|---|
| Avtorji: | ID Cilar Budler, Leona (Avtor)
ID Chen, Hongyu (Avtor)
ID Chen, Aokun (Avtor)
ID Topaz, Maxim (Avtor)
ID Tam, Wilson (Avtor)
ID Bian, Jiang (Avtor)
ID Štiglic, Gregor (Avtor) |
|---|
| Datoteke: |  https://wires.onlinelibrary.wiley.com/doi/10.1002/widm.70010
 WIREs-Data-Min-Knowl---2025---Budler---A-Brief-Review-on-Ben.pdf (943,83 KB)
MD5: 132DFD2ED2C2E99251CEF9B5CEE42FF8
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Znanstveno delo |
|---|
| Tipologija: | 1.02 - Pregledni znanstveni članek |
|---|
| Organizacija: | FZV - Fakulteta za zdravstvene vede
FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | This paper reviews benchmarking methods for evaluating large language models (LLMs) in healthcare settings. It highlights the importance of rigorous benchmarking to ensure LLMs' safety, accuracy, and effectiveness in clinical applications. The review also discusses the challenges of developing standardized benchmarks and metrics tailored to healthcare-specific tasks such as medical text generation, disease diagnosis, and patient management. Ethical considerations, including privacy, data security, and bias, are also addressed, underscoring the need for multidisciplinary collaboration to establish robust benchmarking frameworks that facilitate LLMs' reliable and ethical use in healthcare. Evaluation of LLMs remains challenging due to the lack of standardized healthcare-specific benchmarks and comprehensive datasets. Key concerns include patient safety, data privacy, model bias, and better explainability, all of which impact the overall trustworthiness of LLMs in clinical settings. |
|---|
| Ključne besede: | artificial intelligence, benchmarking, chatbots, healthcare, large language models, natural language processing |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 17.02.2025 |
|---|
| Datum sprejetja članka: | 11.03.2025 |
|---|
| Datum objave: | 01.01.2025 |
|---|
| Založnik: | Wiley |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | str. 1-16 |
|---|
| Številčenje: | Letn. 15, išt. 2, št. članka e70010 |
|---|
| PID: | 20.500.12556/DKUM-92741  |
|---|
| UDK: | 004.89:614 |
|---|
| COBISS.SI-ID: | 234990851 |
|---|
| DOI: | 10.1002/widm.70010 |
|---|
| ISSN pri članku: | 1942-4795 |
|---|
| Datum objave v DKUM: | 12.05.2025 |
|---|
| Število ogledov: | 183 |
|---|
| Število prenosov: | 21 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
