Big Data- Spark Scala

3 months ago


Stockholm, Sweden Dabster Full time
Mandatory Skills Should have years of experience in testing and test automation with Robot framework and python Knowledge of data manipulation using various data formats XML CSV JSON plain text etc and experience with SQL queries preparation Experience of Designing Editing effective reusable automated tests Collaborating with QA Analysts and Software Developers to develop test automation solutions Designing and developing test automation scripts Contribute in defining the overall automated test strategy approach for team and following test automation guidelines strategy Analyse and comment requirements and technical designs from a test perspective Designing implementing and executing test cases by automated test methods Gathering and managing test data Monitoring and documenting test results Report debug and verify defects Collaboration with the team to prepare setup monitor CICD delivery pipelines Good Knowledge on Tools like JIRAALMBIT BucketGIT Excellent communication and teamwork skills Great attention to detail Coordinates with various functions within the company and client organization and ensure timely delivery Own the deliverable task What you'll be doing Building distributed and highly parallelized big data processing pipeline which process massive amount of data both structured and unstructured data in near real-time Leveraging Spark to enrich and transform corporate data to enable searching data visualization and advanced analytics Working closely with analysts and business stakeholders to develop analytics models Continuous delivering on Hadoop and other Big Data Platforms Automating processes where possible and are repeatable and reliable Working closely with QA team As an expert Data Engineer, you are expected to have Excellent Programming language skills Spark Scala BashUnix Scripting SQL Bash Excellent understanding of Hadoop and HDFS Architecture Excellent understanding of file types their pros and cons Excellent understanding of Build Tools especially SBTGradle Very good understanding and good experience in implementing CICD eg Building and Maintaining Jenkins Pipelines Working experience in SAFeAgile As an expert you are also responsible for Juniors writing maintainable code Are collaborative and achieve your expectations through communication and teamwork Are curious responsive and can understand the needs of others to ensure delivery of the desired results Work qualitatively and strive to always do things better Skills Spark Scala Scala with a focus on the programming Apache Spark x Spark query tuning and performance optimization Understanding on Hadoop Architecture Experience working with Hive SQL and HDFS Deep understanding of distributed systems eg CAP theorem partitioning replication consistency and consensus Good to have experience in Scala Experience working with tools like Jenkins Jira Bitbucket and Git Experience in writing shell scripts and working with Linux platforms As an advantage familiarity with one or more of the below technologies Experience working in AgileSAFe Experience certification with AWS Cloud ETL Testing
  • Big Data Engineer

    4 weeks ago


    Stockholm, Stockholm, Sweden Dabster Full time

    Job DescriptionAt Dabster, we are seeking a highly skilled Big Data Engineer - Spark Scala to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Apache Spark and Scala.Key ResponsibilitiesDesign and develop distributed data processing...

  • Big Data Engineer

    3 days ago


    Stockholm, Stockholm, Sweden Dabster Full time

    About the RoleWe are seeking a highly skilled Distributed Big Data Processing Specialist to join our team at Dabster. As an expert in big data processing, you will be responsible for designing and developing distributed big data processing pipelines that process massive amounts of structured and unstructured data in near real-time.As a key member of our...

  • Data Engineer

    3 weeks ago


    Stockholm, Stockholm, Sweden Dabster Full time

    Job SummaryAs a Data Engineer at Dabster, you will be responsible for designing, developing, and maintaining large-scale data processing pipelines using Apache Spark and Scala.Key ResponsibilitiesDesign and implement distributed data processing pipelines using Apache Spark and Scala.Work closely with analysts and business stakeholders to develop analytics...


  • Stockholm, Stockholm, Sweden Vipas AB Full time

    About Vipas ABVipas AB is a forward-thinking company specializing in IT consulting, dedicated to delivering innovative solutions that bridge the gap between business goals and technological advancements. Our team of experts excels in software development, DevOps, and engineering, leveraging cutting-edge technologies like Java and Python.Job DescriptionWe are...


  • Stockholm, Stockholm, Sweden Databricks Full time

    Req ID FEQ425R47Databricks is seeking a skilled Data Science Solutions Expert to join our team. As a key member of our customer-facing team, you will work closely with clients to provide technical and business value through hands-on evaluation and Spark programming. Your expertise in Data Science and Analytics will enable you to create customized solutions...


  • Stockholm, Stockholm, Sweden Vipas AB Full time

    Software Developer at Vipas ABVipas AB, a dynamic company in the IT consulting industry, is seeking an experienced Software Developer to join our team. As a key member of our development team, you will work on challenging projects in telecom, automotive, retail, and banking sectors.Company Overview:Vipas AB is a leading IT consulting company that provides...

  • Data Architect

    3 weeks ago


    Stockholm, Stockholm, Sweden Databricks Full time

    Req ID FEQ425R47At Databricks, our core values drive a customer-centric approach, enabling a unified platform for data science and analytics. We strive to empower informed decision-making, making data accessible to everyone. Our aim is to foster a culture of creativity, experimentation, and continuous improvement, using our Databricks Data Intelligence...


  • Stockholm, Stockholm, Sweden PRAGMATIKE Full time

    Job Title: Scala Backend DeveloperAbout the Role:We are seeking a highly skilled Scala Backend Developer to join our team at PRAGMATIKE. As a Scala Backend Developer, you will play a key role in designing and developing robust back-end systems using Scala within a microservices architecture.Key Responsibilities:Design and develop back-end services in Scala...

  • Scala Engineer

    2 months ago


    Stockholm, Sweden PRAGMATIKE Full time

    Job Description Location: Fully remote, EU timezone (CET +/- 2 hours)Start Date: ASAPLanguages: English required As a Scala engineer with our client, you will play a key role in designing and developing robust back-end systems. You will ensure that the platform maintains exceptional performance and reliability for all users. Responsibilities: Design and...

  • Solutions Engineer

    3 months ago


    Stockholm, Sweden Databricks Full time

    Req ID FEQ425R47At Databricks, our core values are at the heart of everything we do; creating a culture of proactiveness and a customer-centric mindset guides us to create a unified platform that makes data science and analytics accessible to everyone. We aim to inspire our customers to make informed decisions that push their business forward. We provide a...


  • Stockholm, Stockholm, Sweden We IT Global AB Full time

    Job Title: Data Engineering SpecialistJob Description:We IT Global AB is seeking a skilled Data Engineering Specialist to join our team. As a Data Engineering Specialist, you will be responsible for designing, building, and maintaining large-scale data systems. Your primary focus will be on ensuring the smooth operation of our data infrastructure, including...

  • Data Engineer

    3 weeks ago


    Stockholm, Stockholm, Sweden H&M Group Full time

    Role OverviewAt H&M Group, we're seeking a talented Data Engineer to join our Portfolio Brands team. This role is a key position in shaping our company's data foundation, driving innovation, and delivering business value.Key ResponsibilitiesCreate and maintain a scalable data architecture for our Portfolio Brands, ensuring seamless data integration and...


  • Stockholm, Sweden Nordea Bank Full time

    Job ID: 26453  Would you like to be a co-driver in supporting our mission to protect the largest Nordic bank and its customers? Nordea’s Cyber Defence Centre Internal Threats team is looking for an experienced professional, willing to take a front seat in developing our existing big data and insider threat capability. At Nordea, we are committed...


  • Stockholm, Stockholm, Sweden Nordea Bank Full time

    Cyber Defence Centre Team OverviewThe Cyber Defence Centre Internal Threats team at Nordea Bank is seeking an experienced professional to support the development of our existing big data and insider threat capability.As a member of our team, you will contribute to preventing, protecting, and identifying potential insider threats, and providing actionable...


  • Stockholm, Stockholm, Sweden Vipas AB Full time

    About Vipas ABVipas AB is a leading IT consulting company that delivers tailored solutions using cutting-edge technologies like Java and Python.We have a strong team of software developers, DevOps engineers, and experts in data engineering who bring years of experience and expertise to the table. Our goal is to help organizations thrive in the vibrant world...

  • Data Engineer

    2 weeks ago


    Stockholm, Sweden ComeOn Group Full time

    ComeOn Group in shortFounded in 2008, ComeOn Group is a leading global player in the rapidly growing iGaming market. Having launched its first online brand in 2010, ComeOn Group is running a wide range of exciting brands across multiple markets. Managing a multi brand portfolio on its proprietary platform providing a secure, innovative and entertainment-led...

  • Cloud Architect

    2 weeks ago


    Stockholm, Stockholm, Sweden Redeploy Full time

    About UsAt Redeploy Insight, we design and implement modern cloud data platforms for clients across the Nordics. Our core focus lies in delivering cutting-edge solutions, including consulting expertise, managed services, and SaaS Data AI platforms. We partner with industry leaders to stay at the forefront of technological innovation.Job OverviewWe are...


  • Stockholm, Stockholm, Sweden Spotify Full time

    Personalization Data EngineerThe Personalization team at Spotify makes deciding what to play next easier and more enjoyable for every listener. We seek to understand the world of music and podcasts better than anyone else so that we can make great recommendations to every individual. Our team is at the forefront of development for Spotify's recommendation...

  • Software Developer

    1 month ago


    Stockholm, Sweden Vipas AB Full time

    Join Our Team VIPAS AB as a Software Developer Do you have what it takes to thrive in the vibrant world of IT consulting? VIPAS AB, a burgeoning company, proudly invites you to embark on your next engaging project as our About VIPAS :Imagine a world where your business technology perfectly aligns with your goals—efficient, scalable, and innovative....

  • Senior Data Engineer

    2 months ago


    Stockholm, Sweden Infotree Global Solutions Full time

    Are you ready to elevate your career in the beautiful city of Stockholm? We are on the lookout for a highly skilled and experienced Senior Data Engineer for a 6-month contract, with the possibility for extension, to join our dynamic team based in Stockholm. With 8-10 years of expertise in the field of data engineering, we seek a professional who is not only...