We are seeking a Lead Apache Airflow Engineer to spearhead the development and enhancement of our workflow orchestration platform. In this role, you will drive the evolution of Airflow components, integrate new versions with Cloud Composer and lead a talented team of engineers in building robust data pipelines.
Please note that working from the office in Gdansk or Wroclaw 3 days per week is required.
Responsibilities
- Develop and maintain Airflow Operators, Hooks and Sensors
- Integrate new Airflow versions with Cloud Composer
- Fix bugs in Airflow and implement improvements
- Implement tests for Airflow, including Unit Testing and Solution Testing
- Create internal documentation for work artifacts
- Lead and mentor a team of Airflow engineers
- Collaborate with Open Source communities to contribute improvements
Requirements
- 5+ years of experience in Python
- 1+ years of relevant leadership experience
- Programming experience with Cloud APIs (REST/RPC)
- Basic knowledge of DevOps/SysAdmin
- Basic understanding of Linux and Kubernetes, including how to build container images
- Familiarity with Cloud platforms
- Expertise in Airflow or similar experience in building workflows (e.g. based on Luigi, Oozie, Argo, Azkaban, Apache HiFi)
- Experience working with Open Source communities
- Communication skills in English, spoken and written (B2+)
Nice to have
- Understanding of Cloud Architecture, including scalability and IaaS principles
We offer
- We gather like-minded people:
- Engineering community of industry professionals
- Friendly team and enjoyable working environment
- Flexible schedule and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities
- We provide growth opportunities:
- Outstanding career roadmap
- Leadership development, career advising, soft skills, and well-being programs
- Certification (GCP, Azure, AWS)
- Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru
- English classes
- We cover it all:
- Stable income (Employment Contract or B2B)
- Participation in the Employee Stock Purchase Plan
- Benefits package (health insurance, multisport, shopping vouchers)
- Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more
- Referral bonuses
- Corporate, social and well-being events
- Please, note:
- The set of bonuses might vary based on the role you apply for – specifics will be discussed with our recruiter during the general interview.
- We will reach out to selected candidates exclusively.
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.