Data Engineer

We are looking for a Data Engineer to join Northvolt's Data & AI Team within the Software Engineering Department. In this role you will have the opportunity to design, construct, and maintain the systems and infrastructure necessary for the acquisition, storage, and analysis of data. Your primary responsibility will involve developing robust data pipelines, integrating data from various sources, and ensuring the reliability and efficiency of data processing workflows.

You will be part of the Data & AI team building the next-gen connected factory. Our cloud-first strategy, implemented in Northvolt Ett, our first Gigafactory in Europe, sets a global example in manufacturing. Our factories produce large amounts of heterogenous data that get uploaded to our cloud platform, and are then processed, organized, and ready for analysis. You will be responsible for the dataplatform powering detailed product traceability, real-time monitoring of manufacturing line effectiveness, computer vision defect detection, and machine learning (ML) and artificial intelligence (AI) modeling to predict quality and performance of the produced battery cells. Check out our blueprint strategy for our factories at Northvolt’s next-gen connected factory—a digital blueprint factory built from scratch | Amazon Web Services We presented our vision and progress at AWS re:Invent 2023 (Northvolt part starts at 11:46)

Key responsibilities

• Design, develop, and maintain scalable data pipelines and E(T)LT processes to ingest, process, and store structured and unstructured data from various sources
• Collaborate with cross-functional teams to understand data requirements and implement solutions that meet business needs
• Optimize data workflows for performance, reliability, and efficiency, ensuring timely and accurate delivery of data to downstream applications and users
• Implement data quality checks, monitoring, and logging mechanisms to ensure the integrity and reliability of data pipelines
• Continuously evaluate and recommend new technologies, tools, and frameworks to improve data processing capabilities and infrastructure scalability
• Work closely with data architects to design and implement data models and schema designs that support business analytics and reporting needs
• Support data scientists and analysts by providing access to clean and curated data sets for analysis and modeling
• Troubleshoot and resolve data-related issues, including performance bottlenecks, data discrepancies, and system failures
• Document technical designs, processes, and best practices to facilitate knowledge sharing and collaboration within the team
• Stay up-to-date with industry trends and emerging technologies in data engineering and recommend strategies for future development and growth
• Leverage AWS cloud computing to design and process large datasets
• Travel to meet with teams and stakeholders when needed and may include on-call duty

Qualifications

• Preferably 2 years of experience in a data engineering role, preferably in the manufacturing or R&D sector

Techstack and Specific skills

• Python, Golang and SQL and NoSQL database technologies

• Linux/*NIX environments and version control

• Data serialization, transfer protocols and file formats

• Design and implementation of software for distributed systems

• Cloud (AWS/GCP/Azure): Data storage, processing, and compute technologies
• Data Transformation and WMS (e.g. Spark/Flink/Beam, Airflow/Flyte/Luigi/Prefect)
• Data Modeling (e.g. (de)normalization for OLTP/OLAP)
• DevOps with CI/CD using Github/Gitlab

Personal success factors

• Strong problem-solving skills and analytical thinking
• Excellent communication skills, with the ability to present technology in a clear and concise manner
• Ability to work effectively in a team and collaborate with diverse groups of people
• Self-motivated and able to work independently
• Willingness to travel as required