Data Engineer

ABOUT THE PROJECT

Risk & Compliance technology design and deploy cutting edge technology to defend the bank and its customers from Sanctions Risk, Financial Crime Risk, Identity Threat, Unauthorised Trading and Market Abuse & Regulatory Sanctions, as well as supporting Enterprise Risk Management.  We provide the systems that enable our global businesses to grow through data-driven, pro-active risk management.

We are seeking Data Engineer who will be understanding data structures, end to end data flow and working on delivering data pipelines within Risk & Compliance area. The Data Engineer works closely with Business Stakeholders to understand their requirements & propose solution for their problems. In this role you will collaborate with engineering teams from Poland, India & UK, supporting project delivery activities but also BAU post system Go Live.

YOUR RESPONSIBILITIES

• Work closely with Business & IT partners to understand data requirements.

• Together with Architecture & Engineering Team propose technical solution.

• Participate in data pipeline delivery, testing & validation up to production.

• Support and maintain solution after Go Live.

SKILLS & EXPERIENCE WE REQUIRE

• 5+ years of experience in developing data propagation pipeline with Python spark, conversion of SQLs into spark scripts.

• Good understanding on SQL, ETL concepts, writing complex queries using multiple joins, unions etc. 

• Be able to breakdown complex SQL logic and translate it for implementation in Pyspark. 

• Good development experience in PySpark

• Strong analytical skills and proficient in creating efficient data pipelines is key

• Understanding of configuration management, orchestration, containerization, and deployment automation.  Deployment automation of cloud projects (GCP preferred)

• Good experience in GCP Data Proc, Big query, GKE will be an advantage

WHAT WE OFFER

• Competitive salary

• Annual performance-based bonus

• Additional bonuses for recognition awards

• Multisport card

• Private medical care

• Life insurance

• One-time reimbursement of home office set-up (up to 800 PLN).

• Corporate parties & events

• CSR initiatives

• Nursery discounts

• Financial support with trainings and education

• Social fund

• Flexible working hours 

• Free parking