Senior Azure Data Engineer

Senior Azure Data Engineer - Minimum 7 years of experience

Start Date: ASAP / Within 1 Month / Flexible

Contract Type: B2B

Work Model: Hybrid – Warsaw

Key Responsibilities

• Support the migration to Azure Databricks

• Design metadata-driven ETL/ELT pipelines using medallion architecture

• Automate deployments via CI/CD (Azure DevOps, GitHub, Jenkins)

• Collaborate with stakeholders to ensure data quality and governance

• Optimize Spark/PySpark pipelines for performance and cost

• Mentor engineering teams and promote cloud-native best practices

  
  

Tech Stack

• Programming: Python, PySpark, SQL, SparkSQL, Bash

• Azure: Databricks, Data Factory, Delta Lake, Data Vault 2.0

• CI/CD: Azure DevOps, GitHub, Jenkins

• Orchestration: Airflow, Azure Data Factory

• Databases: SQL Server, Oracle, PostgreSQL, Vertica

• Cloud: Azure (expert), AWS (intermediate)

• Tools: FastAPI, REST APIs, Docker, Unity Catalog

  
  

Preferred Certifications

• Azure Data Engineer Associate (DP-203)

• Databricks Lakehouse Fundamentals

• Apache Airflow DAG Authoring

• Cloudera Spark Development

  
  

Project Overview: We are seeking a Senior Azure Data Engineer to support the migration of BI reports as part of a broader Cloudera-to-Azure transition. The role involves re-architecting legacy platforms, implementing scalable data pipelines, and ensuring compliance with regulatory standards.

Benefits

• Medicover healthcare

• Multisport card

• E-learning platform access

• Group life insurance