| Title: | Generating test cases for automotive requirement testingusing rag : magistrsko delo |
|---|
| Authors: | ID Krepek, Matic (Author) ID Klančnik, Simon (Mentor) More about this mentor...  ID Dvoršek, Nejc (Comentor) |
| Files: | MAG_Krepek_Matic_2025.pdf (5,84 MB, This file will be accessible after 16.09.2028) MD5: DF2CBCA46359ED5DF6C6AA4471692043
|
|---|
| Language: | English |
|---|
| Work type: | Master's thesis/paper |
|---|
| Typology: | 2.09 - Master's Thesis |
|---|
| Organization: | FS - Faculty of Mechanical Engineering
|
|---|
| Abstract: | The automotive industry is increasingly confronted with challenges in managing complex requirements and test cases arising from the integration of advanced electronic systems, software functionalities, and compliance with international standards. Conventional manual validation of requirements is time-consuming, error-prone, and resource-intensive, underscoring the need for more efficient and reliable approaches. This thesis investigates the automation of test case generation through the application of Retrieval-Augmented Generation (RAG) in combination with Large Language Models (LLMs). A complete RAG workflow was implemented in Python, incorporating LangChain, LangGraph, Ollama, and ChromaDB to facilitate indexing, retrieval, and generation. The system was trained and evaluated on datasets comprising automotive requirements and test cases, with experiments examining embedding quality, retrieval strategies, prompt engineering techniques, and generative model parameters. The results demonstrate that RAG is capable of generating high-quality, contextually relevant test cases on consumer-grade hardware, thereby significantly enhancing efficiency, consistency, and productivity relative to manual methods. Furthermore, the findings suggest that RAG-based systems are best positioned as complementary tools that support, rather than replace, human engineers. This research provides a foundation for future work on hybrid retrieval methods, advanced embedding techniques, and the integration of more powerful LLMs into requirement and test case management processes. |
|---|
| Keywords: | automotive requirements validation, test case generation, large Language Models, Retrieval-Augmented Generation |
|---|
| Place of publishing: | Maribor |
|---|
| Place of performance: | Maribor |
|---|
| Publisher: | [M. Krepek] |
|---|
| Year of publishing: | 2025 |
|---|
| Number of pages: | 1 spletni vir (1 datoteka PDF (XVI, 69 f.)) |
|---|
| PID: | 20.500.12556/DKUM-95104  |
|---|
| UDC: | 629.3.05.018(043.2) |
|---|
| COBISS.SI-ID: | 258059779  |
|---|
| Publication date in DKUM: | 01.10.2025 |
|---|
| Views: | 362 |
|---|
| Downloads: | 0 |
|---|
| Metadata: |  |
|---|
| Categories: | KTFMB - FS
|
|---|
|
:
|
Copy citation |
|---|
| | | | Average score: | (0 votes) |
|---|
| Your score: | Voting is allowed only for logged in users. |
|---|
| Share: |  |
|---|
Hover the mouse pointer over a document title to show the abstract or click
on the title to get all document metadata. |