| Naslov: | Impact of developer queries on the effectiveness of conversational large language models in programming |
|---|
| Avtorji: | ID Taneski, Viktor (Avtor)
ID Karakatič, Sašo (Avtor)
ID Rek, Patrik (Avtor)
ID Jošt, Gregor (Avtor) |
|---|
| Datoteke: |  applsci-15-06836-v3.pdf (994,41 KB)
MD5: B03C7CFF080684EE2F63BADBAD2581E7
 https://www.mdpi.com/2076-3417/15/12/6836
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | This study investigates the effects of LLM-based coding assistance on web application development by students using a frontend framework. Rather than comparing different models, it focuses on how students interact with LLM tools to isolate the impact of query type on coding success. To this end, participants were instructed to rely exclusively on LLMs for writing code, based on a given set of specifications, and their queries were categorized into seven types: Error Fixing (EF), Feature Implementation (FI), Code Optimization (CO), Code Understanding (CU), Best Practices (BP), Documentation (DOC), and Concept Clarification (CC). The results reveal that students who queried LLMs for error fixing (EF) were statistically more likely to have runnable code, regardless of prior knowledge. Additionally, students seeking code understanding (CU) and error fixing performed better, even when normalizing for previous coding ability. These findings suggest that the nature of the queries made to LLMs influences the success of programming tasks and provides insights into how AI tools can assist learning in software development. |
|---|
| Ključne besede: | large language models, LLMs, prompt engineering, query type analysis, AI-assisted programming, educational software development |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 05.05.2025 |
|---|
| Datum sprejetja članka: | 14.06.2025 |
|---|
| Datum objave: | 17.06.2025 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2025 |
|---|
| Št. strani: | 22 str. |
|---|
| Številčenje: | Vol. 15, iss. 12, [article no.] 6836 |
|---|
| PID: | 20.500.12556/DKUM-93383  |
|---|
| UDK: | 004.43 |
|---|
| COBISS.SI-ID: | 240210435 |
|---|
| DOI: | 10.3390/app15126836 |
|---|
| ISSN pri članku: | 2076-3417 |
|---|
| Datum objave v DKUM: | 23.06.2025 |
|---|
| Število ogledov: | 178 |
|---|
| Število prenosov: | 15 |
|---|
| Metapodatki: |    |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |
