| Title: | Exploring the feasibility of generative AI in persona research : a omparative analysis of large language model-generated and human-crafted personas in obesity research |
|---|
| Authors: | ID Smrke, Urška (Author)
ID Rehberger, Ana (Author)
ID Plohl, Nejc (Author)
ID Mlakar, Izidor (Author) |
|---|
| Files: |  applsci-15-01937-v2.pdf (812,18 KB)
MD5: 06E543B88DBC1421E53B56339ECE90F7
|
|---|
| Language: | English |
|---|
| Work type: | Article |
|---|
| Typology: | 1.01 - Original Scientific Article |
|---|
| Organization: | FERI - Faculty of Electrical Engineering and Computer Science
FF - Faculty of Arts
|
|---|
| Abstract: | This study investigates the perceptions of Persona descriptions generated using three different large language models (LLMs) and qualitatively developed Personas by an expert panel involved in obesity research. Six different Personas were defined, three from the clinical domain and three from the educational domain. The descriptions of Personas were generated using qualitative methods and the LLMs (i.e., Bard, Llama, and ChatGPT). The perception of the developed Personas was evaluated by experts in the respective fields. The results show that, in general, the perception of Personas did not significantly differ between those generated using LLMs and those qualitatively developed by human experts. This indicates that LLMs have the potential to generate a consistent and valid representation of human stakeholders. The LLM-generated Personas were perceived as believable, relatable, and informative. However, post-hoc comparisons revealed some differences, with descriptions generated using the Bard model being in several Persona descriptions that were evaluated most favorably in terms of empathy, likability, and clarity. This study contributes to the understanding of the potential and challenges of LLM-generated Personas. Although the study focuses on obesity research, it highlights the importance of considering the specific context and the potential issues that researchers should be aware of when using generative AI for generating Personas. |
|---|
| Keywords: | user personas, obesity, large language models, value sensitive design, digital health interventions |
|---|
| Publication status: | Published |
|---|
| Publication version: | Version of Record |
|---|
| Submitted for review: | 05.02.2025 |
|---|
| Article acceptance date: | 11.02.2025 |
|---|
| Publication date: | 13.02.2025 |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | 19 str. |
|---|
| Numbering: | Vol. 15, iss. 4, [article no.] 1937 |
|---|
| PID: | 20.500.12556/DKUM-91860  |
|---|
| UDC: | 004.5 |
|---|
| ISSN on article: | 2076-3417 |
|---|
| COBISS.SI-ID: | 226175491 |
|---|
| DOI: | 10.3390/app15041937 |
|---|
| Copyright: | © 2025 by the authors |
|---|
| Publication date in DKUM: | 14.02.2025 |
|---|
| Views: | 162 |
|---|
| Downloads: | 16 |
|---|
| Metadata: |    |
|---|
| Categories: | Misc.
|
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |
