Azure Data Engineer

Information about the project:

Industry: aviation

Rate: up to 180 pln/h net + VAT, B2B

Location: fully remote

Project language: Polish, English

Introduction & Summary:

We are seeking a highly skilled Azure Data Engineer with a strong software engineering and DataSecOps background. The ideal candidate will possess extensive knowledge of CICD tools and significant experience working with Databricks and the Azure analytics stack. Successful candidates will demonstrate a capacity for translating complex technical concepts into simpler terms while contributing to the integrity and scalability of data solutions.

Main Responsibilities:

• Curating structured, semi-structured, and unstructured data through efficient data pipelines.

• Creating and maintaining a robust pipeline architecture, ensuring data quality and reliability.

• Managing large, complex data sets to fulfill both functional and nonfunctional business requirements.

• Identifying and implementing process improvements while optimizing data delivery.

• Collaborating closely with Product Owners, Scrum Masters, and Enterprise Data Management leadership.

• Aligning with Data Engineering chapter standards and mentoring team members.

• Designing scalable, cost-effective data solutions with architects.

Key Requirements:

• 6 years of experience in a Data Engineer role and a degree in Computer Science, Statistics, Informatics, Information Systems, or related fields.

• Solid software engineering and DataSecOps background, including expertise with CICD tools.

• Proficiency with Databricks, especially recent features.

• Experience with the Microsoft Azure analytics stack and various real-time analytics tools.

• Advanced SQL skills and familiarity with multiple databases.

• Understanding of data modeling techniques for analytics.

• Ability to conduct root cause analysis on data processes.

• Experience with data security operations on Azure.

• Skills to troubleshoot complex data-related issues effectively.

• Awareness of data management frameworks (e.g., DAMA) and knowledge of data quality and catalog tools.

• API development skillsets for serving real-time data.

Nice to Have:

• Familiarity with data quality frameworks.

• Experience with tools like Collibra or Alation.

Other Details:

This role requires flexibility to work between 7/8 a.m. and 3/4 p.m. CET. Candidates must demonstrate good verbal and written communication skills in English (B2, C1, or C2 level is required).