Data Engineer AWS & Databricks

🚀 We are looking for an Data Engineer who is skilled in AWS & Databricks to work on a project in a team of our client, (a Swedish-based leading provider of transport solutions.)

 In the role of Data Engineer you will:

• Maintaining, developing, and optimizing tools (framework) and ELT (DataOps) processes built and managed in Databricks using Python.
• Supporting and improving CI/CD solutions, with a strong emphasis on Data Engineering (DataOps) workflows.
• Collaborating with Data Scientists to prepare data for optimization applications and machine learning projects.
• Developing and maintaining the analytical platform based on AWS and Databricks, troubleshooting issues, and enhancing platform efficiency.
• Participating in data processing projects using an internal ELT framework or alternative technical solutions, depending on project needs, to support ML and business process optimization.
• Monitoring ELT process performance and proposing improvements in data processing workflows.
• Working closely with business teams to understand their needs and deliver high-quality data processing solutions.
• Taking ownership of tasks with a strong emphasis on independent work and self-planning.

You might be the perfect match if you possess the following competencies:

• 5+ years' experience as a Data Engineer, ideally working on projects based on open-source technologies
• Working experience with AWS Cloud
• Have experience with Python and data processing libraries (PySpark, Pandas, PolaRS)
• Extensive experience with Databricks and Spark
• Experience with DataOps workloads and CI/CD processes
• Fluency in English

🙌 Nice to have:

• Experience with Machine Learning and optimization projects
• Knowledge of ELT/ETL strategies and frameworks
• Experience with GitLab

By joining Holisticon Insight you will get:

• Life insurance
• Multisport card
• Fully remote job
• Private medical care
• Flexible working hours
• B2B or contract of employment
• Amazing integration events on a regular basis
• Training budget (e.g. Microsoft Azure Certifications)
• Opportunity to impact our company culture build-up
• Work equipment (laptop, 2 monitors, and accessories)

Our recruitment process consists of the following steps:

• Initial interview with Joanna, our recruiter - 30 minutes
• Technical interview with one of our technical interviewers - 30-45 minutes
• Interview with the client - 1 hour