Senior Data Engineer

Role: Senior Data Engineer

Location: Hybrid work with 1 day per week office presence – Gdansk/Gdynia/ Warszawa or Łodź

Industry: Banking

Remuneration: up to 180 PLN/h net+vat (B2B)

Type of contract: B2B

Duration: Long-term cooperation

About the role:

As Senior/Expert Data Engineer you will be building data systems and applications to support decision making processes.

You will also focus on developing and maintaining data pipelines in public clouds like AWS.

You will be participating in data migration from on-premise to public clouds and building components for central enterprise data platforms.

Responsibilities:

• Building distributed and highly parallelized Big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time
• Leveraging Spark to enrich and transform corporate data to enable searching, data visualization, and advanced analytics
• Working closely with analysts and business stakeholders to develop analytics models
• Continuous delivering on Hadoop and other Big Data Platforms
• Automating processes where possible and are repeatable and reliable
• Working closely with QA team

Requirements:

This position will require advanced technical depth and experience, technical leadership, and multi-faceted communication skills.

You are expected to have:

• Experience in Spark & Scala - minimum 5 years
• Experience in Python - minimum 7 years
• Experience in Linux - minimum 5 years
• Experience with distributed data processing engines like Spark
• Experience with Hadoop and (Hive, Oozie, map reduce, etc)
• Strong/Advanced SQL skills
• Previous experience in creating data flows
• BitBucket and GIT expert
• AWS experience or certification
• Unit testing Experience (Junit 5, Mockito, Spark testing)
• Advanced English skills

Nice to have:

• Code versioning strategy & Branching strategy
• Familiar with Agile/Safe framework