Senior Data Engineer

Senior Data Engineer (PySpark)

📍 Location: Kraków, Poland (hybrid: 2 days in the office, 3 days remote)

📄 B2B Contract: 200 – 240 PLN / hour

We are looking for a proactive Senior Data Engineer (PySpark) to join an international Agile team delivering large‑scale data processing solutions for the financial sector. You will work closely with Engineers, Data Analysts and Business Analysts to design, build and optimize data pipelines supporting critical business processes.

This role sits within a collaborative engineering environment and offers the opportunity to influence architecture, development standards and delivery quality across a complex data ecosystem.

Key Responsibilities:

• Design and develop scalable data processing solutions using PySpark or Scala.

• Build and maintain data pipelines leveraging Hadoop ecosystem components (Spark, Hive, YARN, MapReduce).

• Promote engineering best practices through code reviews, mentoring and knowledge sharing.

• Provide production support, troubleshoot issues and ensure system stability.

• Implement tools and processes ensuring performance, availability, accuracy and monitoring.

• Collaborate with Business Analysts to ensure correct interpretation and implementation of requirements.

• Contribute to architecture and system design discussions.

• Participate in Agile ceremonies: sprint planning, reviews, retrospectives and daily stand‑ups.

Requirements:

• 5+ years of experience in software engineering with strong focus on PySpark development.

• Hands‑on experience with Apache Spark, Hadoop, Hive, Spark SQL.

• Experience with Airflow or similar scheduling tools.

• Solid understanding of Unix/Linux environments.

• Experience with ETL frameworks, SQL, RESTful services and distributed data processing.

• Familiarity with Git/GitHub, CI/CD tools (Jenkins, Ansible) and JIRA.

• Understanding of data modelling (relational & non‑relational).

• Strong debugging skills and ability to clearly communicate findings.

Nice to Have:

• Experience with Elasticsearch.

• Java API development.

• Experience with ingestion frameworks.

• Understanding of cloud design patterns.

• Exposure to DevOps practices and Agile methodologies (Scrum, Kanban).

What We Offer:

• Long‑term cooperation within a large, international financial programme.

• Real influence on architecture, engineering standards and delivery quality.

• Work in a multicultural, distributed environment.

• Private medical care (LuxMed) and Multisport card.

• Stable B2B contract with attractive hourly rate.

Why apply for an Antal job offer?

When your application is successful, you will be supported by a dedicated Consultant who will stay in regular contact with you (via email or phone), help you prepare for interviews with your future employer, and ensure a smooth and professional recruitment process.

About Antal

Antal is a leading recruitment and HR advisory company, present in Poland since 1996 and later expanded to the Czech Republic and Hungary. Across the CEE region, we employ around 150 professionals who deliver a full range of services – from specialist and executive recruitment, employee outsourcing and HR consulting, to employer branding and market research.

Our division-based structure combines deep industry expertise with functional specialisation, enabling us to provide tailored solutions for companies in every sector. We act as a trusted partner for both employers and candidates, sharing our knowledge and guiding them through every stage of the talent journey. We connect exceptional people with the right opportunities and help organisations build successful teams.