Data Engineer AWS & Databricks

🚀 We are looking for a Data Engineer with expertise in AWS & Databricks to join an exciting project for our client – a leading Swedish provider of transport solutions.

You will be part of a small, agile team responsible for the end-to-end implementation of optimization and machine learning projects, as well as maintaining and improving a cutting-edge Databricks data processing platform.

 In the role of Data Engineer you will:

• Maintaining, developing, and optimizing tools (framework) and ELT (DataOps) processes built and managed in Databricks using Python.
• Supporting and improving CI/CD solutions, with a strong emphasis on Data Engineering (DataOps) workflows.
• Collaborating with Data Scientists to prepare data for optimization applications and machine learning projects.
• Developing and maintaining the analytical platform based on AWS and Databricks, troubleshooting issues, and enhancing platform efficiency.
• Participating in data processing projects using an internal ELT framework or alternative technical solutions, depending on project needs, to support ML and business process optimization.
• Monitoring ELT process performance and proposing improvements in data processing workflows.
• Working closely with business teams to understand their needs and deliver high-quality data processing solutions.
• Taking ownership of tasks with a strong emphasis on independent work and self-planning.

You might be the perfect match if you possess the following competencies:

• 5+ years' experience as a Data Engineer, ideally working on projects based on open-source technologies
• Working experience with AWS Cloud
• Have experience with Python and data processing libraries (PySpark, Pandas, PolaRS)
• Extensive experience with Databricks and Spark
• Experience with DataOps workloads and CI/CD processes
• Fluency in English

Nice to have:

• Experience with Machine Learning and optimization projects
• Knowledge of ELT/ETL strategies and frameworks
• Experience with GitLab

By joining Holisticon Insight you will get:

• Life insurance
• Multisport card
• Fully remote job
• Private medical care
• Flexible working hours
• B2B or contract of employment
• Amazing integration events on a regular basis
• Training budget (e.g. Microsoft Azure Certifications)
• Opportunity to impact our company culture build-up
• Work equipment (laptop, 2 monitors, and accessories)

🔍Our recruitment process consists of the following steps:

1️⃣ Initial chat with Joanna, our recruiter – 30 minutes

2️⃣ Technical interview with our expert – 30-45 minutes

3️⃣ Final interview with the client – 1 hour