Senior Data Engineer – Big Data & Cloud Technologies

Unleash the Power of Data — Shape the Future of Big Data & Cloud Innovation!

Krakow-based opportunity with hybrid work model, allowing up to 3 days remote per week.

As a Senior Data Engineer, you will be working for our client, a leading player in the data and analytics industry. You will contribute to designing and building scalable, high-performance data pipelines that drive business insights and innovation. This role offers a unique chance to be at the forefront of big data and cloud technologies, shaping meaningful solutions for global clients.

Your main responsibilities:

• Develop and optimize data pipelines using PySpark, Scala, and Hadoop components to support scalable analytics solutions.
• Work with Apache Spark, Hive, YARN, and ETL frameworks to process large datasets efficiently.
• Collaborate with Business Analysts to interpret requirements and translate them into technical solutions.
• Implement and maintain automated testing, deployment, and monitoring tools to ensure system reliability.
• Provide production support, troubleshoot issues, and improve performance and scalability.
• Participate actively in Agile rituals, including sprint planning, reviews, and retrospectives.
• Contribute to system architecture and design discussions, ensuring best practices and standards.

You're ideal for this role if you have:

• 4+ years of experience in data engineering or similar roles.
• Strong proficiency in PySpark or Scala development and design.
• Hands-on experience with scheduling tools such as Airflow.
• Knowledge of Hadoop ecosystem components (Hive, Spark, Spark SQL, YARN).
• Experience with SQL, RESTful services, and Unix/Linux environments.
• Familiarity with version control (Git, GitHub), CI/CD tools (Jenkins, Ansible), and requirement management systems (JIRA).

It is a strong plus if you have: (optional)

• Experience with Elasticsearch.
• Development experience with Java APIs.
• Knowledge of data ingestion techniques.
• Understanding of cloud design patterns.
• Exposure to DevOps methodologies and Agile practices like Scrum and Kanban.

Language Required for the role:

• Fluent in English.

Eligibility for the role:

• Only candidates with an existing legal right to work in Europe will be considered for this role.

#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.