Master's thesis:On the evaluation of AI-driven code and test generation agents

1 week ago

Borås, Västra Götaland, Sweden RISE Research Institutes of Sweden Full time

Master's thesis:On the evaluation of AI-driven code and test generation agents

Background
The field of software development is being transformed by the rapid rise of AI agents. These systems are increasingly automating tasks that were traditionally performed by developers. While this automation improves efficiency, it also introduces challenges around oversight, validation, and ensuring the safety and reliability of the generated outputs. This thesis explores these challenges by focusing on the development and evaluation of AI coding agents.

Description
Coding agents powered by large language models (LLMs) have recently reached a level of maturity that enables their use in production environments. However, running large LLMs can be computationally expensive and impractical. A promising alternative is the use of smaller, specialized language models trained for specific tasks such as code and test generation.

This thesis will investigate the effectiveness of such small-scale models in generating both code and tests. In particular, it will evaluate how these models impact the safety, security, and reliability of generated code, and explore methodologies for assessing their performance in real-world scenarios. The thesis is planned to be done as part of the European project HIVEMIND (Human-centred collaboratIVE MultI-ageNt framework for accelerating software Development and maintenance).

Key Responsibilities
The following tasks will be undertaken within this project:

  • Conduct a literature review of existing methods for evaluation of AI-driven code/test generation
  • Based on the literature review, choose an appropriate method or combine several methods to create one, and evaluate the code/test generating agent.
  • Build a prototype code-and-test-generating agent using small yet specialized models.
  • Evaluate the quality as well as safety and security of the developed agent based on the chosen methodology.
  • Document the findings and learnings from the use of the created agent, apart from the regular thesis presentation and thesis report.

Qualifications
Candidates are expected to be enrolled in a master's program in a field related to computer science and engineering, control and mechatronics, or complex systems. Having already completed AI-related courses is an advantage.

Terms
As a master's thesis candidate in this project, you will work with researchers from the Dependable Transport Systems at RISE. We will provide you with the infrastructure and support to perform your thesis work. This thesis is located in Borås, physical presence is expected to some degree. Start is beginning of 2026. We encourage applications from two students who want to work together on the project.

Compensation: 1,000 SEK per credit after project completion and approval, if more than one student 1,333 SEK per credit after project completion and approval, if one student.

Welcome with your application
Last day of application; January

Contact; Behrooz Sangshoolie,

  • Master's thesis: Intelligent tools for generating test scenarios of the future for Autonomous Vehicles

    3 days ago

    Borås, Västra Götaland, Sweden RISE Research Institutes of Sweden Full time

    Master's thesis: Intelligent tools for generating test scenarios of the future for Autonomous VehiclesBackgroundThe development and deployment of autonomous vehicles (AVs) require extensive testing and validation to ensure safety and reliability. Traditional testing methods, such as real-world driving tests, are costly, time-consuming, and cannot cover all...

  • Master's thesis: Intelligent tools for generating test scenarios of the future for Autonomous Vehicles

    3 days ago

    Borås, Västra Götaland, Sweden RISE Research Institutes of Sweden AB Full time

    BackgroundThe development and deployment of autonomous vehicles (AVs) require extensive testing and validation to ensure safety and reliability. Traditional testing methods, such as real-world driving tests, are costly, time-consuming, and cannot cover all possible edge cases for modern AI based solutions. Scenario-based testing has emerged as a promising...

  • Customer Support Agent – Borås

    2 weeks ago

    Borås, Västra Götaland, Sweden TF Bank Full time

    Customer Support Agent – BoråsWe are looking for a proactive and service-minded Customer Support Agent to join our team in Borås. In this role, you will support both the Swedish and Danish markets and handle a variety of back-office tasks.About the RoleAs a Customer Support Agent, you will handle incoming inquiries from Swedish customers via phone and...

  • Customer Support Agent – Borås

    3 days ago

    Borås, Västra Götaland, Sweden TF Bank AB (publ) Full time

    We are looking for a proactive and service-minded Customer Support Agent to join our team in Borås. In this role, you will support both the Swedish and Danish markets and handle a variety of back-office tasks.About The RoleAs a Customer Support Agent, you will handle incoming inquiries from Swedish customers via phone and email, as well as email-based...

  • Senior Frontend Developer

    1 week ago

    Borås, Västra Götaland, Sweden Enad Full time

    Do you want to help develop the next generation SaaS platform for e-commerce?Do you enjoy creating modern, fast, and sustainable digital experiences—while contributing to a product used by some of the strongest e-commerce brands in the Nordics? Then Enad might be the right place for you.About EnadEnad is a SaaS company developing modern software for...

  • Frontend Developer

    3 days ago

    Borås, Västra Götaland, Sweden Centiro Full time

    Innovate, Build, Impact - Build World-Class Digital ExperiencesAre you ready to revolutionize the future of digital experiences in an innovative, global environment? Centiro is looking for a passionate and experienced Frontend Developer to drive the creation of world-class products that make a real impact. If you're eager to push the boundaries of web...

  • Doktorand i design med inriktning modedesign

    3 days ago

    Borås, Västra Götaland, Sweden Högskolan i Borås Full time

    BoråsDiarienummer: PA2025/197Vid Akademin för textil, teknik och ekonomi bedrivs forskning och utbildning inom företagsekonomi, industriell ekonomi, resursåtervinning, samhällsbyggnad och inom det textila området: design, management och teknik. Inom akademin finns fem institutioner: Institutionen för företagsekonomi och textilt management,...

  • Biträdande universitetslektor i textilteknologi

    3 days ago

    Borås, Västra Götaland, Sweden Högskolan i Borås Full time

    BoråsDiarienummer: PA2025/146Inom Textilhögskolan vid Högskolan i Borås möts kreativitet, kunskap och innovation. Våra unika labbmiljöer och kompetenser representerar stora delar av den textila värdekedjan. Det nära samarbetat med branschen bidrar till forskningens och utbildningarnas relevans och gör Textilhögskolan till en central aktör för...

  • Provningschef, AstaZero

    6 days ago

    Borås, Västra Götaland, Sweden RISE Research Institutes of Sweden AB Full time

    Vill du vara med och forma framtidens mobilitet och bidra till ett säkrare och mer hållbart transportsystem? Vi söker nu en engagerad och resultatinriktad enhetschef som vill leda, utveckla och växa med en central del av AstaZeros verksamhet. Här får du möjlighet att kombinera ledarskap, affärsutveckling och tekniskt ansvar i en roll med stort...

  • Provningsingenjör till EMC-testning hos RISE

    3 days ago

    Borås, Västra Götaland, Sweden Jefferson Wells Sverige Full time

    Är du nyfiken på framtidens teknik och vill vara med där innovationen sker? Vill du få chansen att arbeta i norra Europas största EMC-anläggning och bidra till att nya produkter blir säkra, tillförlitliga och redo för marknaden? Vi söker dig som brinner för elektronik, kommunikationsteknik och avancerad provning – och som vill vara en del av ett...