| Naslov: | Evaluating the usability and functionality of intelligent source code completion assistants: a comprehensive review |
|---|
| Avtorji: | ID Hliš, Tilen (Avtor) ID Četina, Luka (Avtor) ID Beranič, Tina (Avtor) ID Pavlič, Luka (Avtor) |
| Datoteke: | applsci-13-13061.pdf (590,64 KB) MD5: E1045A168186C747761A9BA123476043
https://www.mdpi.com/2076-3417/13/24/13061
|
|---|
| Jezik: | Angleški jezik |
|---|
| Vrsta gradiva: | Članek v reviji |
|---|
| Tipologija: | 1.01 - Izvirni znanstveni članek |
|---|
| Organizacija: | FERI - Fakulteta za elektrotehniko, računalništvo in informatiko
|
|---|
| Opis: | As artificial intelligence advances, source code completion assistants are becoming more advanced and powerful. Existing traditional assistants are no longer up to all the developers’ challenges. Traditional assistants usually present proposals in alphabetically sorted lists, which does not make a developer’s tasks any easier (i.e., they still have to search and filter an appropriate proposal manually). As a possible solution to the presented issue, intelligent assistants that can classify suggestions according to relevance in particular contexts have emerged. Artificial intelligence methods have proven to be successful in solving such problems. Advanced intelligent assistants not only take into account the context of a particular source code but also, more importantly, examine other available projects in detail to extract possible patterns related to particular source code intentions. This is how intelligent assistants try to provide developers with relevant suggestions. By conducting a systematic literature review, we examined the current intelligent assistant landscape. Based on our review, we tested four intelligent assistants and compared them according to their functionality. GitHub Copilot, which stood out, allows suggestions in the form of complete source code sections. One would expect that intelligent assistants, with their outstanding functionalities, would be one of the most popular helpers in a developer’s toolbox. However, through a survey we conducted among practitioners, the results, surprisingly, contradicted this idea. Although intelligent assistants promise high usability, our questionnaires indicate that usability improvements are still needed. However, our research data show that experienced developers value intelligent assistants highly, highlighting their significant utility for the experienced developers group when compared to less experienced individuals. The unexpectedly low net promoter score (NPS) for intelligent code assistants in our study was quite surprising, highlighting a stark contrast between the anticipated impact of these advanced tools and their actual reception among developers. |
|---|
| Ključne besede: | intelligent assistants, source code completion, source code |
|---|
| Status publikacije: | Objavljeno |
|---|
| Verzija publikacije: | Objavljena publikacija |
|---|
| Poslano v recenzijo: | 26.10.2023 |
|---|
| Datum sprejetja članka: | 05.12.2023 |
|---|
| Datum objave: | 07.12.2023 |
|---|
| Založnik: | MDPI |
|---|
| Leto izida: | 2023 |
|---|
| Št. strani: | 18 str. |
|---|
| Številčenje: | Vol. 13, iss. 24, [article no.] 13061 |
|---|
| PID: | 20.500.12556/DKUM-88708  |
|---|
| UDK: | 004.9 |
|---|
| COBISS.SI-ID: | 176535555  |
|---|
| DOI: | 10.3390/app132413061  |
|---|
| ISSN pri članku: | 2076-3417 |
|---|
| Datum objave v DKUM: | 21.05.2024 |
|---|
| Število ogledov: | 356 |
|---|
| Število prenosov: | 55 |
|---|
| Metapodatki: |  |
|---|
| Področja: | Ostalo
|
|---|
|
:
|
Kopiraj citat |
|---|
| | | | Skupna ocena: | (0 glasov) |
|---|
| Vaša ocena: | Ocenjevanje je dovoljeno samo prijavljenim uporabnikom. |
|---|
| Objavi na: |  |
|---|
Postavite miškin kazalec na naslov za izpis povzetka. Klik na naslov izpiše
podrobnosti ali sproži prenos. |