Senior Data Engineer

Workplace: 100% remote

Notice period: 30 days

Form of cooperation: B2B contract with ITFS

Rate: 140 - 170 PLN/h + VAT

Client: international bank

Technology stack: Scala, Python, Spark

Language: English (min. B2)

The recruitment process: screening call with ITFS (~ 20 minues)  → technical interview with the client → decision

As an Expert Data Engineer you will be building data systems to support decision making processes.

You will focus on developing and maintaining data pipelines.

This position will require advanced technical depth and experience, and communication skills.

What you’ll be doing:

• Building a distributed and highly parallelized Big data processing pipeline which process massive amount of data (both structured and unstructured data) in near real-time

• Leveraging Spark and Scala to transform corporate data to enable data products to be built

• Continuous delivery on Hadoop and other Big Data Platforms

• Automating processes where possible and are repeatable and reliable

Must have:

• Experience in Spark & Scala - minimum 5 years;

•  Experience in Python - minimum 7 years

•  Experience in Linux - minimum 5 years

•  Experience with distributed data processing engines like Spark

•  Experience with Hadoop and (Hive, Oozie, map reduce, etc)

•  Strong/Advanced SQL skills

•  Previous experience in creating data flows

•  BitBucket and GIT expert

•  Unit testing Experience (Junit 5, Mockito, Spark testing)

•   Advanced English skills

Must-have knowledge and experience:

To succeed in this role, we believe that you:

• Are collaborative and achieve your expectations through communication and teamwork

• Are curious, responsive and can understand the needs of others to ensure delivery of the desired results

• Work qualitatively and strive to always do things better

• Have a high level of self-motivation

Nice to have:

• Code versioning strategy & Branching strategy

• Familiar with Agile/Safe framework

We offer:

• Transparent terms of cooperation with a company with a secure and stable market position and opportunities for growth.

• Access to benefits (co-financing for Enel-med and Multisport healthcare packages, and a basic accounting package – free for up to three invoices per month).