Azure Data Engineer

Location: Hybrid work, Wrocław or Poznań (2 days per week onsite at the Client’s office)

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Delta Lake.

• Implement data applications in Python with transformations and aggregations using PySpark, including ingestion, data historization, integration, and filtering.

• Develop and maintain data quality frameworks, observability, and monitoring tools.

• Collaborate with stakeholders to gather and understand data requirements, ensuring high data quality.

• Optimize performance and cost-efficiency of data workflows in Azure Databricks.

Requirements

• Proven hands-on experience with Azure cloud services, particularly Data Lake and Databricks.

• Strong proficiency in Python and PySpark for large-scale data processing.

• Ability to develop Python applications and automation scripts.

• Experience with version control systems (e.g., Git) and CI/CD practices.

Offer

• Medicover healthcare package

• Multisport card

• Access to an e-learning platform

• Group life insurance