20.500.12556/DKUM-97514 Development and evaluation of a generative AI chatbot for database searching in systematic review Introduction Systematic reviews (SRs) require comprehensive, reproducible searches, yet developing search strategies is resource-intensive and demands specialized expertise. Generative AI offers potential to streamline this process, but empirical evaluations for GAI-assisted SR searching remain scarce. The objectives of this study are to: demonstrate a step-by-step process for developing a custom ChatGPT-based chatbot to support SR search strategy development, and evaluate its performance. Design A cross-sectional evaluation study. Methods We used ChatGPT-4.0 to create a chatbot designed to mimic a medical librarian, generating PICO-informed searches. Its knowledge base was augmented with two methodological references. After piloting testing, we refined its instructions. For evaluation, we randomly sampled 50 Cochrane SRs published in 2024. Standardized P–I–O prompts produced database-ready queries for PUBMED and EMBASE. The primary outcome was per-review success rate, summarized by median and inter-quartile range. A sensitivity analysis was conducted. Results Pilot testing achieved a retrieval rate of 41/49 (83.7%). In the main sample (1169 studies; median 13.5 studies per SR), the chatbot identified a median of 67.4% of included studies (IQR: 43.1%–88.4%). When limited to indexed studies (n = 1114), retrieval rose to 72.0% (IQR: 46.0%–92.5%). Lower performance was observed when outcomes were absent from the abstracts or interventions had many lexical variants. Conclusions A GAI-based chatbot can rapidly generate SR searches (~67%–72% identification), serving as a useful starting point but not a replacement for expert-led approaches. Integration of librarian expertise, structured prompts, and controlled vocabularies may improve performance. Further benchmarking and transparent reporting are needed to guide adoption. database searching generative artificial intelligence large language model systematic review razvoj iskalnih strategij generativna umetna inteligenca veliki jezikovni model sistematični pregledi true true true Wiley Angleški jezik Slovenski jezik Znanstveno delo 2026-03-13 17:38:32 2026-03-19 14:56:36 2026-03-20 03:10:50 0000-00-00 00:00:00 2026 0 0 str. 1-7 št. 2, št. članka e70076 Letn. 58 Mar. 2026 0000-00-00 Zaloznikova Objavljeno NiDoloceno 2025-10-13 2026-02-17 2026-03-10 007.52+004.8:025.4.036:004.65 271552515 10.1111/jnu.70076 1547-5069 J_of_Nursing_Scholarship_-_2026_-_Tam_-_Development_and_Evaluation_of_a_Generative_AI_Chatbot_for_Database_Searching_in.pdf J_of_Nursing_Scholarship_-_2026_-_Tam_-_Development_and_Evaluation_of_a_Generative_AI_Chatbot_for_Database_Searching_in.pdf 1 8498E1E2F58433264ACFA44F9AE8B076 a8253d7ea34786103d4204bcf32b0e7ec66e2f4631d0f51e25040468eddd518a 234d98d6-1efb-11f1-80ac-00155d580e1a https://dk.um.si/Dokument.php?lang=slv&id=204532 https://sigmapubs.onlinelibrary.wiley.com/doi/10.1111/jnu.70076 1 12e71994-1efb-11f1-80ac-00155d580e1a https://dk.um.si/Dokument.php?lang=slv&id=204531 Fakulteta za zdravstvene vede 0 0 0