THESIS: What security risks are introduced by Generative AI in Software development?
6 days ago
High level description
Generative AI is increasingly used in software development to write code, tests and suggest solutions. This increases productivity but at the cost of several risks, one being security. The AI tools being used may generate code that contains vulnerabilities, reproduce insecure patterns from training data, or create a false sense of confidence among developers who use the tools without critical review. Understanding these risks is essential both for developers to work safely with AI and for companies to make well-informed decisions regarding the integration of AI tools into their workflows.
Who are we looking for?
Bachelor/Master of Science in Computer Science/Engineering
Project description
This thesis will investigate the security risks introduced by using generative AI in the software development process. As tools like GitHub Copilot and ChatGPT become increasingly integrated into development workflows, they offer clear benefits in terms of efficiency and productivity. However, their outputs may also contain subtle vulnerabilities, reuse insecure coding practices from training data, or encourage overreliance by developers who assume correctness without proper verification.
This thesis aims to study these issues systematically through a combination of literature review, code generation experiments, and interviews with practitioners. By analysing AI-generated code using static analysis tools and penetration testing, the thesis will identify common patterns of security weaknesses.
The results will be synthesized into a framework that categorizes risks and highlights mitigation strategies. The goal is to provide practical insights that help developers, teams, and organizations use generative AI responsibly and securely in their software development processes.
Purpose and Scope
• Identify and categorize the most common types of security vulnerabilities present in AI generated code.
• Analyse how the use of generative AI affects developers' ability to recognize and prevent security risks.
• Evaluate existing mitigation strategies and propose practical guidelines or best practices for safe use of AI tools.
• Provide actionable insights for both developers and organizations regarding secure integration of AI into development workflows.
• Delimit the study to risks associated with code generation in the development phase, excluding broader ethical or legal aspects such as copyright.
An Exciting Journey with Knightec Group
Semcon and Knightec have joined forces as Knightec Group. Together, we are Northern Europe's leading strategic partner in product and digital service development. With a unique combination of cross-functional expertise and a holistic business understanding, we help our clients realize their strategies – from idea to complete solution.
Practical Information
This is a thesis position, located at our office in Sundsvall. Start date January or March 2026.
Please submit your application as soon as possible, but no later than If you have any questions, you are welcome to contact Johanna Edström. Note that due to GDPR, we only accept applications through our careers page.
-
Sundsvall, Sweden Knightec Group Full time 60,000 - 80,000 per yearAbstractManaging third-party dependencies is critical for software security, yet existing tools such as Dependabot treat all version updates and reported vulnerabilities as equally urgent. This lack of prioritization leads to alert fatigue and wasted developer effort. This thesis explores how AI can make dependency risk management more contextual and...
-
THESIS: AI Imposter validation
6 days ago
Sundsvall, Sweden Knightec Group Full time 40,000 - 60,000 per yearHigh level descriptionWith the rapid advancement of artificial intelligence, AI-driven communication tools such as chatbots, virtual assistants, and deepfake voice generators, are becoming increasingly indistinguishable from human interaction. While these technologies offer numerous benefits, they also pose significant risks by blurring the line between...
-
Sundsvall, Sweden Knightec Group Full time 400,000 - 600,000 per yearHigh level descriptionEffort and time estimation remain among the most challenging aspects of software engineering. Despite decades of research, human estimates are still often uncertain and inconsistent.With the rise of advanced AI assistants and code-generating tools such as GitHub Copilot, ChatGPT, Amazon CodeWhisperer, and similar systems, new...
-
Sundsvall, Sweden Knightec Group Full time 400,000 - 600,000 per yearHigh level descriptionWith the rising popularity of AI agents, Anthropic has developed a new protocol for LLM models to communicate with tools. The Model Context Protocol (MCP) is slowly becoming a standard for developing tools for LLMs and LLM Agents. In MCP there are no security or authentication methods, so exposing tools towards end users can be harmful...
-
THESIS: Advancing Software Testing with AI
6 days ago
Sundsvall, Sweden Knightec Group Full time 400,000 - 600,000 per yearHigh level descriptionThis project examines the application of artificial intelligence in translating change requests into automated test cases by referencing software interface descriptions, aiming to enhance verification coverage and overall software quality.Who are we looking for?Bachelor/Master of Science in Computer Science/EngineeringProject...
-
THESIS: Enriching APIs with AI
6 days ago
Sundsvall, Sweden Knightec Group Full time 450,000 - 600,000 per yearBackgroundIn today's digital landscape, services and offerings are increasingly composed of multiple interconnected applications and systems. This complexity makes it difficult to trace which services are tied to a specific customer identifier and to detect issues such as failed orders or recurring system errors.Traditionally, support and operations teams...
-
Sundsvall, Sweden Knightec Group Full time 450,000 - 550,000 per yearHigh level descriptionAI agents in Customer Success can streamline documentation by automatically capturing key insights from customer interactions and updating knowledge bases with accurate, easy-to-find content. They can analyze large sets of customer data to identify trends, summarize findings, and prepare structured updates. For monthly reporting, AI...
-
Sundsvall, Sweden Knightec Group Full time 350,000 - 550,000 per yearHigh level descriptionComponent reusability is essential for maintaining consistency and efficiency in modern software development organizations. Traditional npm packages (either public or private) have long been the standard approach for sharing code across projects, while shadcn's registry system represents a newer paradigm that focuses on code ownership...
-
Sundsvall, Sweden Knightec Group Full time 550,000 - 750,000 per yearHigh level descriptionThis project explores the application of artificial intelligence in software engineering to accelerate the formulation of change requests from initial business needs and enhance the precision of early-stage estimates.Who are we looking for?Bachelor/Master of Science in Computer Science/EngineeringProject descriptionUtilizing prompt...
-
Sundsvall, Sweden Knightec Group Full time 450,000 - 550,000 per yearHigh level descriptionModern data engineering faces unprecedented challenges as organizations increasingly deploy IoT devices and edge computing infrastructure that generate massive volumes of distributed data.Traditional centralized data processing approaches struggle with the latency, bandwidth, and reliability constraints inherent in edge-to-cloud data...