Senior Data Engineer

Role overview

We are looking for an experienced Senior Data Engineer to join a long-term data engineering initiative focused on building and developing scalable, cloud-based data solutions.

The role combines strong Python development with hands-on work across AWS services and data pipelines. You will be responsible for developing reusable data processing components, maintaining existing solutions, troubleshooting complex pipeline issues, and supporting the evolution of the wider data platform.

We are looking for someone who is comfortable working independently on technical challenges while collaborating closely with an agile, international team.

Key responsibilities:

• Design, develop, and maintain scalable data pipelines and data processing solutions.

• Build reusable and configurable modules in Python that can support different business requirements and environments.

• Apply object-oriented programming (OOP) principles and modern Python engineering practices to create maintainable and scalable solutions.

• Work hands-on with AWS services, including Glue, Athena, DynamoDB, Step Functions, and Lambda.

• Investigate and resolve issues across existing data pipelines, including root-cause analysis and implementation of robust fixes.

• Support changes and migrations within the data platform, including pipeline updates, validation, end-to-end testing, and related technical activities.

• Contribute to code quality through testing, version control, CI/CD practices, and maintainable development standards.

• Collaborate with developers, data specialists, and other stakeholders within an agile delivery environment.

Requirements:

• Strong commercial experience in Data Engineering, ideally around 5–10 years.

• Advanced Python programming skills, particularly:

  • pandas for data processing and manipulation,

  • object-oriented programming (OOP),

  • writing clean, reusable, and maintainable code.

• Hands-on experience with AWS, particularly:

  • AWS Glue,

  • Amazon Athena,

  • DynamoDB,

  • AWS Step Functions,

  • AWS Lambda.

• Solid experience designing, developing, and maintaining data pipelines.

• Good understanding of cloud-based data architectures and data processing solutions.

• Experience working in agile development environments.

• Ability to independently troubleshoot and debug complex data and pipeline-related issues.

• Experience working in international or distributed project environments.

Nice to have:

• Experience with Veeva or similar platforms.

• Previous exposure to pharmaceutical or healthcare data environments.

• Experience with CI/CD, automated testing, and modern software engineering practices.

• Familiarity with tools such as Azure DevOps or similar development and delivery platforms.