AI Test Automation Consultant

9 hours ago

Malmo, Skåne, Sweden Hays Full time

Title:
AI Test Automation Engineer

City of Work: Malmö, Skåne County, Sweden

Start date:

End date:

Availability: 100%

Ways of working: hybrid (50% on-site)

Role & tasks:

As an
AI Test Automation Engineer
in our team
,
you play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy.

You will perform the day-to-day test activities throughout the software delivery lifecycle. Your primary objective is to support the team in achieving quality-focused activities and goals with excellence, enabling essential confidence of the deliverables.

For this specific position, we require
an automation-first mindset and hands-on experience testing non-deterministic AI systems
, including conversational flows, retrieval grounding, and regression caused by prompt, configuration, or model changes.

To be successful in this role, we assume you have experience in various software development teams within large organizations, and you fulfill the following
key responsibilities:

  • Assess, plan, and execute the quality-focused work and processes on all test levels, including test automation, tailored to the context specific needs and risks
  • Design, implement, and maintain automation-first test suites covering conversational flows,
    multi-turn context and RAG retrieval accuracy
  • Perform API and integration testing
    for
    backend systems supporting the AI assistant
  • Establish joint processes that transparently and continuously feedback progress, outcomes, risks and potential challenges of test activities to team members, with support of the Test lead
  • Actively participate in the preparation, breakdown, and analysis of the planned solutions, providing inputs from a quality-, risk- and testability perspective
  • Transparently feedback on the outcome of performed test activities and analyze the results
  • Actively and continuously feedback revealed risks and defects according to set processes
  • Actively take part in discussions regarding defects mitigation
  • Define test scenarios and produce required test artefacts
  • Implement, maintain and improve agreed test automation activities and outcome

Required qualifications:

Proven hands-on experience

  • testing AI-driven conversational / chat-based solutions
  • designing, implementing, and maintaining automated
    test frameworks for AI / chat systems
    (manual testing limited to exploratory only)
  • testing RAG-based AI solutions
    , including retrieval accuracy, grounding, source relevance, and hallucination prevention
  • validating natural language interactions, including intent recognition, entity extraction, and multi-turn conversational context
  • testing
    non-deterministic AI behavior
    , defining acceptable response quality
  • testing prompt, configuration, and model version changes, including automated regression
  • testing API-based and backend integrations supporting AI agents
  • test planning, estimation, execution, reporting, and defect management for complex systems
  • working in agile software development in hybrid or cross-functional environments
  • using
    Atlassian Jira
    for test management, defect tracking, and reporting
  • In-depth knowledge of software testing principles, automation strategies, and tools applied across the SDLC

Strong understanding of data privacy, security, and compliance considerations

Languages: fluent in English and Swedish

  • Test Automation Engineer

    6 days ago

    Malmo, Skåne, Sweden Rasulson Consulting Full time

    Role DescriptionWe are looking for a Test Automation Engineer to support testing activities for a new Dynamics 365 Finance and Operations platform. The assignment focuses on ensuring high and consistent quality through well-structured test processes and extensive automation of regression testing.ResponsibilitiesReview and validate acceptance criteria to...

  • Test Automaton Engineer

    1 week ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Automation Engineer

    9 hours ago

    Malmo, Skåne, Sweden Capgemini Full time

    Att välja Capgemini innebär att välja en arbetsplats där du ges möjlighet att forma din karriär på det sätt du själv önskar, där du ingår i en stödjande och inspirerande gemenskap med engagerade kollegor världen över, och där du får chansen att omdefiniera vad som är möjligt. Våra Cloud & Custom applications-team fokuserar på att...

  • Test Engineer

    2 days ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Automation Engineer FnO

    1 week ago

    Malmo, Skåne, Sweden Solvex Solutions Full time

    Test Automation Engineer – D365 Finance & Operations (Hybrid – Malmö)Location:Malmö, Sweden (On-site 2–3 days/week)Duration:Long-term (6+ months with extensions)Start:ASAPWe are looking for aTest Automation Engineerto support testing activities for a newly implementedDynamics 365 Finance & Operations (D365 F&O)platform.This role plays a key part in...

  • Test Lead

    2 weeks ago

    Malmo, Skåne, Sweden Telavox Full time

    Join Telavox as a Test LeadAre you a hands-on quality professional who enjoys working closely with teams to build reliable, high-performing software? At Telavox, we are transforming the future of Unified Communications as a Service (UCaaS), and we're looking for a Test Lead who can strengthen our testing practices, secure platform stability, and foster a...

  • Test Lead

    2 weeks ago

    Malmo, Skåne, Sweden Telavox Full time

    Join Telavox as a Test Lead Are you a hands-on quality professional who enjoys working closely with teams to build reliable, high-performing software? At Telavox, we are transforming the future of Unified Communications as a Service (UCaaS), and we're looking for a Test Lead who can strengthen our testing practices, secure platform stability, and foster a...

  • Test Architect

    1 week ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Test Architect

    2 weeks ago

    Malmo, Skåne, Sweden Deploja AB Full time

    We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...

  • Lead Consultant

    1 week ago

    Malmo, Skåne, Sweden Carve Consulting Full time

    Lead the next frontier of ServiceNow: Source-to-Pay, Vendor Management & AI Innovationand become part of a growing consulting company in Copenhagen, just a 40-minute train ride from Malmö and a 5-minute walk from the station.About usCarve is a consulting firm with 50 professionals, recognized for our strong capabilities in operational excellence. Our edge...