Data Engineer - Spark, Scala/Java

Data Engineer – Spark, Scala/Java

Key Responsibilities:

• Developing, managing, and optimizing data pipelines.

• Engaging with team developers and architects to shape the process implementation framework.

• Estimating workload and regularly updating progress on solution development.

• Cooperating closely with stakeholders to refine solution details and validate requirements.

• Supporting business teams in understanding technical possibilities, offering optimal solutions, and clarifying constraints.

• Establishing efficient workflows, proposing, and executing process enhancements.

Desired Qualifications:

• Proficiency in Scala or Java with substantial experience.

• Minimum 4–5 years of relevant experience

• Hands-on expertise in working with Spark.

• Familiarity with CI/CD methodologies and tools such as GitHub Actions.

• Knowledge of cloud platforms (GCP) and infrastructure as code (Terraform) is a plus.

• Experience with Airflow is an added advantage.

• Background in data pipeline testing is beneficial.

• A business- and product-centric approach with direct experience in stakeholder collaboration.

• Banking sector experience is a plus.

• Prior work experience in Scrum and agile methodologies.

• Strong analytical skills with the ability to address intricate technical challenges.

• Passion for tackling challenges that foster both personal and professional development.

• A collaborative mindset with a willingness to learn and grow.

• Proficiency in English is essential.