Master's thesis: Language Models on the Resource Constrained Edge

6 days ago

Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 156,000 - 350,000 per year

Master's thesis: Language Models on the Resource Constrained Edge

Background.
Large Language Models are powerful but resource-intensive, limiting their deployment on edge devices. This project explores a novel neural network attention mechanism—
Inhibitor Transformer
—designed for low-power, low-memory environments. The work is hosted by
RISE Research Institutes of Sweden
, a state-owned research institute that supports sustainable innovation across industry, academia and the public sector.

Description.
This thesis investigates the deployment of the Inhibitor Transformer on platforms such as IoT devices, FPGAs, and RISC-V processors. The project includes hardware-specific optimizations, simulation of deployment scenarios, and benchmarking for performance and energy efficiency. A key goal is to identify the most suitable hardware platform and implement a working prototype.

Key Responsibilities

  • Conduct a literature review on efficient attention mechanisms and hardware-aware model design
  • Implement the Inhibitor Transformer and optimize it for selected hardware platforms
  • Simulate and benchmark performance, memory usage, and energy efficiency
  • Deploy a working prototype on real hardware
  • Document findings in a scientific report

Qualifications

  • Strong background in mathematics, machine learning, deep neural network architectures
  • Experience with hardware-aware computing or embedded systems is a plus
  • Proficiency in Python and frameworks like PyTorch or TensorFlow
  • Familiarity with hardware platforms such as FPGAs, RISC-V, or IoT devices is advantageous

Terms
Scope: 30 hp, full-time

Location: Luleå (or remote with agreement)

Start: Flexible

Compensation: 10,000 SEK for travel, materials and the like after the project is completed and approved.

Please note
: You need to have a valid student visa that allows you to study in Sweden during the thesis period.

We look forward to receiving your application
Last day of application: 30 November, 2025.

Contact: Rickard Brännvall ), Henrik Barestrand, Joakim Eriksson

Check-in questions (yes/no): 1-5 are required, 6-9 are beneficial, 10 and 11 are specifically a plus .

  • Master's thesis; Next-Generation Connectivity and Edge AI for Industry Use Cases

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 30,000 - 39,990 per year

    We are looking for 4–5 motivated Master's thesis students to join the Digital Testbed Sweden (DTSE) initiative. Together, you will explore how next-generation technologies like 5G, Edge AI, and IoT can be applied to real-world challenges in smart recycling (Boden) and smart & safe ports (Luleå).About The ProjectDigital Testbed Sweden is a collaborative...

  • Master's thesis; Grid To Chip Technologies

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden AB Full time 900,000 - 1,200,000 per year

    BackgroundRISE Data center systems is a research unit within RISE focusing on the data center industry. RISE ICE Data Center is a specialized research facility used in research and innovation projects. The primary areas of research at the unit include data center technologies, energy efficiency, cooling systems, digital infrastructure, heat reuse systems and...

  • Master's thesis; Grid To Chip Technologies

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 420,000 - 840,000 per year

    BackgroundRISE Data center systems is a research unit within RISE focusing on the data center industry. RISE ICE Data Center is a specialized research facility used in research and innovation projects. The primary areas of research at the unit include data center technologies, energy efficiency, cooling systems, digital infrastructure, heat reuse systems and...

  • Master's thesis; Grid To Chip Technologies

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 500,000 - 750,000 per year

    BackgroundRISE Data center systems is a research unit within RISE focusing on the data center industry. RISE ICE Data Center is a specialized research facility used in research and innovation projects. The primary areas of research at the unit include data center technologies, energy efficiency, cooling systems, digital infrastructure, heat reuse systems and...

  • Master's thesis; Encrypted Camera Surveillance at the Edge

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 40,000 - 80,000 per year

    Background.With rising concerns aroundnational security, total defence, and organized crime, there is a growing need for surveillance technologies that supportlaw enforcement and public safety—without compromising individual privacy. This project explores the use ofFully Homomorphic Encryption (FHE)to enable secure, on-device surveillance that protects...

  • Master's thesis: Forgotten-by-Design for Privacy-Preserving AI

    6 days ago

    Luleå, Norrbotten, Sweden RISE Research Institutes of Sweden Full time 360,000 - 420,000 per year

    Master's thesis: Forgotten-by-Design for Privacy-Preserving AIBackground.As AI systems increasingly handle sensitive personal data, ensuring compliance with privacy regulations such as the GDPR—including theright to be forgotten—has become a critical challenge. Traditional deletion methods are often insufficient in machine learning, where sensitive data...

  • Master Thesis: Casting Powder Characterisation and Physical Simulation usin

    6 days ago

    Luleå, Norrbotten, Sweden Swerim AB Full time 240,000 - 360,000 per year

    We want to be more The research institute Swerim conducts needs-based industrial research and development concerning metals and their route from raw material to finished product. Swerim has 200 co-workers in two locations in Sweden - Luleå and Stockholm. Our vision is a fossil-free and circular industry. Project Description The project forms part of the...

  • Thesis Work: OPC UA FX as Automation Pattern Benchmark

    6 days ago

    Luleå, Norrbotten, Sweden ABB Full time 1,500 - 2,500 per year

    At ABB, we help industries outrun - leaner and cleaner. Here, progress is an expectation - for you, your team, and the world. As a global market leader, we'll give you what you need to make it happen. It won't always be easy, growing takes grit. But at ABB, you'll never run alone. Run what runs the world.This Position reports to:Service Manager This thesis...

  • Thesis Work: OPC UA FX as Automation Pattern Benchmark

    6 days ago

    Luleå, Norrbotten, Sweden ABB Full time 45,000 - 60,000 per year

    På ABB hjälper vi industrier att bli snabbare, mer resurseffektiva och hållbara. Här är framsteg en självklarhet - för dig, ditt team och hela världen. Som global marknadsledare ger vi dig rätt förutsättningar för att lyckas med det. Det kommer inte alltid att vara enkelt - utveckling kräver mod och styrka. På ABB är du aldrig ensam. Run what...

  • Thesis work 30 ECTS

    6 days ago

    Luleå, Norrbotten, Sweden Scania Group Full time

    IntroductionA thesis project is an excellent opportunity to establish closer contact with Scania and build relationships for the future. Many of today's employees began their Scania careers with their thesis work.BackgroundWith over 125 years of industry experience, Scania strives to be a world-leading provider of sustainable transport solutions. As part of...