Senior Data Engineer

Project info

As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining scalable and efficient data pipelines. Your role will involve collaborating with cross-functional teams to ensure the availability, reliability, and accuracy of data for various analytical and reporting purposes.

Responsibilities

• Write and optimize PySpark code to enable effective execution and transformations of data.
• Design and develop ETL processes and data pipelines to extract, transform, and load data from various sources into target systems.
• Develop and maintain complex SQL queries to extract and manipulate data from databases.
• Utilize Databricks and Notebooks to analyze data, develop prototypes, and provide data insights.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and implement data solutions accordingly.
• Work with the MS Cloud stack, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Power BI, to build robust data solutions.
• Optimize and tune data processes to ensure efficient and scalable performance.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Keep up-to-date with industry trends and best practices in data engineering and apply them to enhance data solutions.

Job Requirements

Must-Have:

• Strong proficiency in writing and transforming PySpark code for efficient data processing and transformations.
• Good understanding of ETL principles, data pipelines, and data integration techniques.
• Proficient in writing efficient and complex SQL queries to extract and manipulate data.
• Hands-on experience with Databricks and Notebooks for data analysis and prototyping.
• Knowledge of the MS Cloud stack, including Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Power BI.

Must possess a legal work permit in Poland

Good-to-Have:

• Familiarity with DevOps tools and practices for CI/CD and automation.
• Familiarity with healthcare data standards, regulations, and best practices.

Qualifications and Skills:

• Bachelor's degree in Computer Science, Engineering, or a related field. A Master's degree is a plus.
• 4+ years of professional experience as a Data Engineer or a similar role.
• Strong problem-solving and analytical skills.
• Excellent communication and interpersonal skills.
• Proven ability to work effectively in a team and collaborate with cross-functional stakeholders.
• Strong attention to detail and a commitment to delivering high-quality results.
• Ability to adapt to a dynamic and fast-paced work environment.
• We offer competitive compensation packages, a collaborative work culture, and opportunities for professional growth and development.

Benefits

General benefits:

• Hybrid work model combining office & remote work
• Attractively located office with collaboration spaces
• Onsite parking space for employees
• Company performance related bonus 
• Referral program with financial bonus
• Life Insurance
• Budget for development (including language courses and others), clear career path with the possibility to gain experience in international environment
• Access to internal Learning Platform with multiple trainings oriented for professional growth

Lifestyle benefits:

• Access to MyBenefit platform (Multisport included)
• Team Building activities 
• Charity initiatives 
• Working environment promoting diversity and inclusion

Health benefits: 

• Private medical care - Platinum Package