AI Test Automation Consultant
22 hours ago
Title:
AI Test Automation Engineer
City of Work: Malmö, Skåne County, Sweden
Start date:
End date:
Availability: 100%
Ways of working: hybrid (50% on-site)
Role & tasks:
As an
AI Test Automation Engineer
in our team
,
you play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy.
You will perform the day-to-day test activities throughout the software delivery lifecycle. Your primary objective is to support the team in achieving quality-focused activities and goals with excellence, enabling essential confidence of the deliverables.
For this specific position, we require
an automation-first mindset and hands-on experience testing non-deterministic AI systems
, including conversational flows, retrieval grounding, and regression caused by prompt, configuration, or model changes.
To be successful in this role, we assume you have experience in various software development teams within large organizations, and you fulfill the following
key responsibilities:
- Assess, plan, and execute the quality-focused work and processes on all test levels, including test automation, tailored to the context specific needs and risks
- Design, implement, and maintain automation-first test suites covering conversational flows,
multi-turn context and RAG retrieval accuracy - Perform API and integration testing
for
backend systems supporting the AI assistant - Establish joint processes that transparently and continuously feedback progress, outcomes, risks and potential challenges of test activities to team members, with support of the Test lead
- Actively participate in the preparation, breakdown, and analysis of the planned solutions, providing inputs from a quality-, risk- and testability perspective
- Transparently feedback on the outcome of performed test activities and analyze the results
- Actively and continuously feedback revealed risks and defects according to set processes
- Actively take part in discussions regarding defects mitigation
- Define test scenarios and produce required test artefacts
- Implement, maintain and improve agreed test automation activities and outcome
Required qualifications:
Proven hands-on experience
- testing AI-driven conversational / chat-based solutions
- designing, implementing, and maintaining automated
test frameworks for AI / chat systems
(manual testing limited to exploratory only) - testing RAG-based AI solutions
, including retrieval accuracy, grounding, source relevance, and hallucination prevention - validating natural language interactions, including intent recognition, entity extraction, and multi-turn conversational context
- testing
non-deterministic AI behavior
, defining acceptable response quality - testing prompt, configuration, and model version changes, including automated regression
- testing API-based and backend integrations supporting AI agents
- test planning, estimation, execution, reporting, and defect management for complex systems
- working in agile software development in hybrid or cross-functional environments
- using
Atlassian Jira
for test management, defect tracking, and reporting - In-depth knowledge of software testing principles, automation strategies, and tools applied across the SDLC
Strong understanding of data privacy, security, and compliance considerations
Languages: fluent in English and Swedish
-
Test Automation Engineer
20 hours ago
Malmo, Skåne, Sweden RED Global Full timeTest Automation Engineer6 Month Contract (Extendable)Malmo - 2/3 days per week in the officeRole & tasksYou play a crucial role in ensuring that the processes and prerequisites necessary for successful testing are carried out, aligned with our overall Quality and Test strategy. You will perform the day to day test activities throughout the software delivery...
-
QA Test Automation Expert
20 hours ago
Malmo, Skåne, Sweden Deploja AB Full timeWe now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...
-
Test Automation Engineer
20 hours ago
Malmo, Skåne, Sweden Swedium Global Services Full timeSwedium Global Services is the growing System Engineering and Solution Company, offers services like Semiconductor Engineering R&D Services, Embedded Systems Development, Custom Application Software Development, Web and Cloud Application Development, Testing Services, Consultancy and Outsourcing services to our clients across the globe for an onsite and...
-
Test Automaton Engineer
21 hours ago
Malmo, Skåne, Sweden Deploja AB Full timeWe now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...
-
Test Engineer
22 hours ago
Malmo, Skåne, Sweden Deploja AB Full timeWe now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...
-
Test Automation Engineer FnO
22 hours ago
Malmo, Skåne, Sweden Solvex Solutions Full timeTest Automation Engineer – D365 Finance & Operations (Hybrid – Malmö)Location:Malmö, Sweden (On-site 2–3 days/week)Duration:Long-term (6+ months with extensions)Start:ASAPWe are looking for aTest Automation Engineerto support testing activities for a newly implementedDynamics 365 Finance & Operations (D365 F&O)platform.This role plays a key part in...
-
Test Specialist Coordinator
22 hours ago
Malmo, Skåne, Sweden Deploja AB Full timeWe now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business, which means you will be employed by us and work either with clients or on internal projects and assignments.As part of your application, you may be presented to clients/partners as part of the...
-
Senior ERP Test Lead
22 hours ago
Malmo, Skåne, Sweden Accelerated Growth AB Full timeAccelerate Your Career with Us – Join Accelerated GrowthRole: ERP Test Manager – Focus ERP preferably Microsoft Business CentralLocation: Malmö (Hybrid flexibility)Level: Senior (5+ years of experience)Languages: Swedish (required), English (required)About Accelerated GrowthAccelerated Growth is a boutique consultancy within strategy, technology,...
-
Test Leader|Test architect
21 hours ago
Malmo, Skåne, Sweden Inter IKEA Group Full timeIKEA is building for the futureThe goal of Range Experience is to support and empower customers to find their personal best home furnishing solutions. We run and develop digital solutions used by customers and co-workers enabling them to design homes and home furnishing solutions for the entire IKEA range. Part of our portfolio are planning solutions for...
-
Test Leader|Test architect
22 hours ago
Malmo, Skåne, Sweden Inter IKEA Group Full timeCompany Description IKEA is building for the future The goal of Range Experience is to support and empower customers to find their personal best home furnishing solutions. We run and develop digital solutions used by customers and co-workers enabling them to design homes and home furnishing solutions for the entire IKEA range. Part of our portfolio are...