Data Engineer

Mode: Remote

Contract: B2B

Summary: The Senior Data Engineer role is crucial for enhancing data products, focused on improving data management processes to support patient care and organizational goals.

Responsibilities:

• Collaborate with cross-functional teams to design, develop, and maintain data pipelines and analytics solutions.

• Design and build a foundational platform for a modern data lake architecture, optimizing it for scalability, flexibility, and performance.

• Develop automated tests to ensure data accuracy and quality.

• Continuously secure improvement to enhance developer efficiency and act as a sparring partner on the use of Azure services for the organization.

• Leverage cloud development expertise to design and implement digital solutions focused on business insights and patient care.

Key Requirements:

• Extensive experience with Azure, Azure Databricks, and a deep understanding of Azure architecture and services.

• Strong proficiency in Python programming.

• Experience using Spark, including Spark SQL, with an understanding of how to optimize Spark performance.

• Automated unit testing and code quality inspection experience.

• Experience with CI/CD (GitHub actions / Azure DevOps).

• Familiarity with AWS.

• Experience in the pharma domain or other regulated areas.

Nice to Have:

• Proven ability to work in a collaborative team environment.

• Willingness to receive and act on feedback for personal and professional growth.

• Fluency in English, both written and spoken.

Other Details:

• Team Structure - Collaborative team focused on innovation in patient care.