| | SLO | ENG | Cookies and privacy

Bigger font | Smaller font

Show document Help

Title:Generating test cases for automotive requirement testingusing rag : magistrsko delo
Authors:ID Krepek, Matic (Author)
ID Klančnik, Simon (Mentor) More about this mentor... New window
ID Dvoršek, Nejc (Comentor)
Files:.pdf MAG_Krepek_Matic_2025.pdf (5,84 MB, This file will be accessible after 16.09.2028)
MD5: DF2CBCA46359ED5DF6C6AA4471692043
 
Language:English
Work type:Master's thesis/paper
Typology:2.09 - Master's Thesis
Organization:FS - Faculty of Mechanical Engineering
Abstract:The automotive industry is increasingly confronted with challenges in managing complex requirements and test cases arising from the integration of advanced electronic systems, software functionalities, and compliance with international standards. Conventional manual validation of requirements is time-consuming, error-prone, and resource-intensive, underscoring the need for more efficient and reliable approaches. This thesis investigates the automation of test case generation through the application of Retrieval-Augmented Generation (RAG) in combination with Large Language Models (LLMs). A complete RAG workflow was implemented in Python, incorporating LangChain, LangGraph, Ollama, and ChromaDB to facilitate indexing, retrieval, and generation. The system was trained and evaluated on datasets comprising automotive requirements and test cases, with experiments examining embedding quality, retrieval strategies, prompt engineering techniques, and generative model parameters. The results demonstrate that RAG is capable of generating high-quality, contextually relevant test cases on consumer-grade hardware, thereby significantly enhancing efficiency, consistency, and productivity relative to manual methods. Furthermore, the findings suggest that RAG-based systems are best positioned as complementary tools that support, rather than replace, human engineers. This research provides a foundation for future work on hybrid retrieval methods, advanced embedding techniques, and the integration of more powerful LLMs into requirement and test case management processes.
Keywords:automotive requirements validation, test case generation, large Language Models, Retrieval-Augmented Generation
Place of publishing:Maribor
Place of performance:Maribor
Publisher:[M. Krepek]
Year of publishing:2025
Number of pages:1 spletni vir (1 datoteka PDF (XVI, 69 f.))
PID:20.500.12556/DKUM-95104 New window
UDC:629.3.05.018(043.2)
COBISS.SI-ID:258059779 New window
Publication date in DKUM:01.10.2025
Views:362
Downloads:0
Metadata:XML DC-XML DC-RDF
Categories:KTFMB - FS
:
Copy citation
  
Average score:(0 votes)
Your score:Voting is allowed only for logged in users.
Share:Bookmark and Share



Hover the mouse pointer over a document title to show the abstract or click on the title to get all document metadata.

Licences

License:CC BY-NC-ND 4.0, Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International
Link:http://creativecommons.org/licenses/by-nc-nd/4.0/
Description:The most restrictive Creative Commons license. This only allows people to download and share the work for no commercial gain and for no other purposes.
Licensing start date:04.09.2025

Secondary language

Language:Slovenian
Title:Generiranje testnih primerov za testiranje avtomobilskih zahtev z uporabo rag
Abstract:V sosobnem času se avtomobilska industrija sooča z naraščajočimi izzivi pri obvladovanju kompleksnih zahtev in testnih primerov, ki izhajajo iz vključevanja naprednih elektronskih sistemov, programske funkcionalnosti ter zahtev mednarodnih standardov. Tradicionalna ročna validacija zahtev je pogosto zamudna, podvržena napakam in zahteva znatne kadrovske ter časovne vire. V okviru magistrske naloge je obravnavana možnost avtomatizacije generiranja testnih primerov z uporabo metodologije Retrieval-Augmented Generation (RAG) v kombinaciji z velikimi jezikovnimi modeli (LLM). V programskem jeziku Python je bil razvit celovit potek RAG, ki vključuje ogrodja LangChain, LangGraph, Ollama in ChromaDB za namene indeksiranja, iskanja in generiranja. Sistem je bil eksperimentalno preizkušen na naborih podatkov, ki zajemajo avtomobilske zahteve in pripadajoče testne primere. Eksperimenti so bili osredotočeni na ocenjevanje kakovosti preslikave besedila v vektorske predstavitve, učinkovitosti različnih strategij iskanja ter vpliva parametrov generativnih modelov na rezultate. Rezultati empirične analize kažejo, da lahko pristop RAG na lokalni potrošniški strojni opremi generira kakovostne in kontekstualno ustrezne testne primere, kar pomembno prispeva k večji učinkovitosti, doslednosti in produktivnosti v primerjavi s tradicionalnimi ročnimi metodami. Ugotovitve nakazujejo, da je uporaba sistemov, temelječih na RAG, smiselna predvsem kot podporno orodje, ki dopolnjuje delo inženirjev, ne pa kot njihova neposredna zamenjava. Predstavljeni rezultati tako predstavljajo osnovo za nadaljnje raziskave na področju hibridnih metod iskanja ter integracije zmogljivejših modelov LLM v proces avtomatizacije validacije zahtev in testnih primerov.
Keywords:validacija avtomobilskih zahtev, generiranje testnih primerov, veliki jezikovni modeli, Retrieval-Augmented Generation


Comments

Leave comment

You must log in to leave a comment.

Comments (0)
0 - 0 / 0
 
There are no comments!

Back
Logos of partners University of Maribor University of Ljubljana University of Primorska University of Nova Gorica