Data Engineer (Python, Databricks)

ROJECT INFORMATION:

• Assignment type: B2B
• Start: ASAP or flexible
• Work model: Remote + 1 day per month in the Warsaw office
• Project length: 12 months + extensions
• Project language: English

PROJECT:

You will join the international Data team that deals with Data Platform (building the platform and feeding it with data from internal and external sources).

RESPONSIBILITIES:

• Collaboration with international data team.
• Designing, developing and maintaining data pipelines.
• Testing.
• Optimizing data platform for scalability and performance.

REQUIREMENTS:

• At least 5 years of experience as Data Engineer and Software Developer.
• Experience with Azure Databricks (must have), and with other Azure services such as Data Factory.
• Experience in SDLC, tests.
• Knowledge in Python programming
• Experience in using Spark, including Spark SQL
• Automated unit testing and code quality inspection
• CI/CD Pipelines
• Fluent spoken and written English
• Working in pharma domain or other regulated area is considered an advantage