Azure Data Engineer

In Cyclad, we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking an enthusiastic and experienced Data Engineer with Azure Stack. You will play a key role in designing, developing, and maintaining data pipelines using Azure Databricks and Delta Lake.

Project information:

• Type of project: IT services

• Office location: Wroclaw and Poznan

• Work mode: hybrid - 1 office day /4 days remotely

• Budget: b2b 100 - 140 PLN/day net

• Project length: long-term

• Only candidates with citizenship in the European Union and residence in Poland

• Start date: ASAP (depending on candidate's availability)

Project scope:

• Designing, developing, and maintaining data pipelines using Azure Databricks and Delta Lake

• Implement data application in Python with transformations and aggregations using PySpark: ingestion, data historization, integration, filtering

• Developing a data quality framework, observability, and monitoring tools

• Collaborate with stakeholders to understand data requirements and ensure data quality

• Optimize performance and cost-efficiency of data workflows in Azure Databricks

Requirements:

• Hands-on experience with Azure cloud services, especially Data Lake and Databricks

• Proficiency in Python and PySpark for large-scale data processing

• Ability to develop Python applications, write automation tasks

• Experience with version control (e.g., Git) and CI/CD practices

• Good command of English

We offer:

• Flexible hybrid working model

• Full-time job agreement based on b2b

• Private medical care with dental care (covering 70% of costs) + rehabilitation package. Family package option possible

• Multisport card (also for an accompanying person)

• Life insurance