Lead Data Engineer

We’re looking for a Lead Data Engineer to help us drive improvements in our data pipeline development for stakeholders across the organisation. You’ll be a part of the Data Management Centre of Excellence within Digital, Data & IT, where we focus on creating high value, innovative data products. Join us in our mission to #BringDataToLife!

Behind the positions

You will be anchored in our data platform product team, where you will join a team forming partnerships with the line of business. You will participate in projects, workshops and PoCs with data engineers and product teams. You will bring your expertise to our partners, with the possibility of more long-term assignments to specific products.

As part of the data platform team, you will be responsible for tools, templates and data engineering practices of strategic importance for data products, and for mentoring colleagues of less experience than yourself.

The position

As Lead Data Engineer, you will join a new team of data engineers in Poland driving ongoing development and delivery of our data management solutions. You will be working in an Agile environment with regular sprint meetings and a daily focus on building new data solutions on AWS, Azure and other platforms. In this role, you will be:

• Providing technical expertise and guidance for the components that make up our data ecosystem on AWS
• In collaboration with your colleagues, leading and defining the end-to-end architecture of our data pipeline solutions
• Taking the role of hands-on developer, tester, integration and deployment specialist on data pipelines
• Build, evangelize and improve data pipeline templates, that other colleagues can utilize to build validated solutions in a streamlined fashion
• Driving continuous improvement using behaviour-driven design principles, DevOps practices, and awareness of compliance requirements
• Coaching and sharing knowledge with colleagues through demos, co-development and sparring, ensuring that expertise is spread across our Data Engineers to enable collaborative ways of working

Qualifications

We’re looking for someone with the following background:

• Master’s degree in computer science, engineering, software development or a related field, with at least 8 years’ experience working with contemporary cloud technologies, preferably AWS.
• Experience deploying with CI/CD and working with modern build, test and deployment tools, ideally in large organisations
• Strong skills with Python and at least one more of the following programming languages: TypeScript, Go, Java, Scala, C++, C# or Rust.
• Strong skills in SQL and experienced with modern data warehouses and data modelling principles
• Experienced with containerization using Docker or similar tools
• Experienced with Spark (preferably on AWS Glue)
• Experienced with software development best practices for writing, reviewing and refactoring code
• The ability to understand complex technical matters, form an educated opinion, and communicate with impact to a variety of stakeholders with different levels of technical expertise.
• Experience working with a regulated industry would be an advantage