Senior Data Engineer

For a client, one of the most recognizable airlines in the world, we are looking for a Senior Data Engineer. The person in this role will be involved in working with large volumes of data, including data modeling, data integrations, and ensuring data quality.

Key responsibilities

• Designing and implementing robust ETL/ELT pipelines

• Implementing efficient Spark/PySpark transformations, managing schemas and Delta Lake versioning

• Integrating streaming and batch data sources

• Implementing data quality control frameworks, monitoring, schema validation, and test suites

• Collaborating on data modeling and metadata management

• Working with technical documentation 

Ideal candidate profile

• Minimum 7 years of professional experience in data engineering, building large-scale data pipelines, or related roles

• Strong knowledge of Azure Databricks, Spark (PySpark and/or Scala), and Delta Lake.

• Experience with ADLS Gen2, data ingestion patterns, and streaming technologies.

• Experience with streaming technologies such as Event Hubs and Kafka.

• Knowledge of CI/CD for data artifacts and deployment practices in Databricks.

• Experience in Python and/or Java, using test-driven development (TDD).

Nice to have:

• Experience with tools such as Unity Catalog, Purview, or other metadata management and governance systems.

• Knowledge of Apache Beam or other data processing frameworks.

• Databricks or Azure Data Engineering certifications.

Conditions

• Working mode: Remote

• Form of cooperation: B2B

• Duration: long-term cooperation

• Salary depends on your experience

• Benefits: private medical care, life insurance, sport card

Recruitment steps

1. Screening call with Recruiter (30 min.)

2. Technical interview with Client

3. Decision and feedback