AI Test Automation Consultant

22 hours ago

Malmo, Skåne, Sweden Hays Full time

Title:
AI Test Automation Engineer

City of Work: Malmö, Skåne County, Sweden

Start date:

End date:

Availability: 100%

Ways of working: hybrid (50% on-site)

Role & tasks:

As an
AI Test Automation Engineer
in our team
,
you play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy.

You will perform the day-to-day test activities throughout the software delivery lifecycle. Your primary objective is to support the team in achieving quality-focused activities and goals with excellence, enabling essential confidence of the deliverables.

For this specific position, we require
an automation-first mindset and hands-on experience testing non-deterministic AI systems
, including conversational flows, retrieval grounding, and regression caused by prompt, configuration, or model changes.

To be successful in this role, we assume you have experience in various software development teams within large organizations, and you fulfill the following
key responsibilities:

  • Assess, plan, and execute the quality-focused work and processes on all test levels, including test automation, tailored to the context specific needs and risks
  • Design, implement, and maintain automation-first test suites covering conversational flows,
    multi-turn context and RAG retrieval accuracy
  • Perform API and integration testing
    for
    backend systems supporting the AI assistant
  • Establish joint processes that transparently and continuously feedback progress, outcomes, risks and potential challenges of test activities to team members, with support of the Test lead
  • Actively participate in the preparation, breakdown, and analysis of the planned solutions, providing inputs from a quality-, risk- and testability perspective
  • Transparently feedback on the outcome of performed test activities and analyze the results
  • Actively and continuously feedback revealed risks and defects according to set processes
  • Actively take part in discussions regarding defects mitigation
  • Define test scenarios and produce required test artefacts
  • Implement, maintain and improve agreed test automation activities and outcome

Required qualifications:

Proven hands-on experience

  • testing AI-driven conversational / chat-based solutions
  • designing, implementing, and maintaining automated
    test frameworks for AI / chat systems
    (manual testing limited to exploratory only)
  • testing RAG-based AI solutions
    , including retrieval accuracy, grounding, source relevance, and hallucination prevention
  • validating natural language interactions, including intent recognition, entity extraction, and multi-turn conversational context
  • testing
    non-deterministic AI behavior
    , defining acceptable response quality
  • testing prompt, configuration, and model version changes, including automated regression
  • testing API-based and backend integrations supporting AI agents
  • test planning, estimation, execution, reporting, and defect management for complex systems
  • working in agile software development in hybrid or cross-functional environments
  • using
    Atlassian Jira
    for test management, defect tracking, and reporting
  • In-depth knowledge of software testing principles, automation strategies, and tools applied across the SDLC

Strong understanding of data privacy, security, and compliance considerations

Languages: fluent in English and Swedish

  • Test Automation Engineer

    20 hours ago

    Malmo, Skåne, Sweden RED Global Full time

    Test Automation Engineer6 Month Contract (Extendable)Malmo - 2/3 days per week in the officeRole & tasksYou play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy. You will perform the day to day test activities throughout the software delivery...

  • QA Test Automation Expert

    20 hours ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Automation Engineer

    20 hours ago

    Malmo, Skåne, Sweden Swedium Global Services Full time

    Swedium Global Services is the growing System Engineering and Solution Company, offers services like Semiconductor Engineering R&D Services, Embedded Systems Development, Custom Application Software Development, Web and Cloud Application Development, Testing Services, Consultancy and Outsourcing services to our clients across the globe for an onsite and...

  • Test Automaton Engineer

    21 hours ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Engineer

    22 hours ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Automation Engineer FnO

    22 hours ago

    Malmo, Skåne, Sweden Solvex Solutions Full time

    Test Automation Engineer – D365 Finance & Operations (Hybrid – Malmö)Location:Malmö, Sweden (On-site 2–3 days/week)Duration:Long-term (6+ months with extensions)Start:ASAPWe are looking for aTest Automation Engineerto support testing activities for a newly implementedDynamics 365 Finance & Operations (D365 F&O)platform.This role plays a key part in...

  • Test Specialist Coordinator

    22 hours ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Senior ERP Test Lead

    22 hours ago

    Malmo, Skåne, Sweden Accelerated Growth AB Full time

    Accelerate Your Career with Us – Join Accelerated GrowthRole: ERP Test Manager – Focus ERP preferably Microsoft Business CentralLocation: Malmö (Hybrid flexibility)Level: Senior (5+ years of experience)Languages: Swedish (required), English (required)About Accelerated GrowthAccelerated Growth is a boutique consultancy within strategy, technology,...

  • Test Leader|Test architect

    21 hours ago

    Malmo, Skåne, Sweden Inter IKEA Group Full time

    IKEA is building for the futureThe goal of Range Experience is to support and empower customers to find their personal best home furnishing solutions. We run and develop digital solutions used by customers and co-workers enabling them to design homes and home furnishing solutions for the entire IKEA range. Part of our portfolio are planning solutions for...

  • Test Leader|Test architect

    22 hours ago

    Malmo, Skåne, Sweden Inter IKEA Group Full time

    Company Description IKEA is building for the future The goal of Range Experience is to support and empower customers to find their personal best home furnishing solutions. We run and develop digital solutions used by customers and co-workers enabling them to design homes and home furnishing solutions for the entire IKEA range. Part of our portfolio are...