Senior Scala Developer

Project information:

• Industry: Banking

• Location: hybrid model 3x/week in office (Gdynia/Gdańsk/Warsaw)

• Remuneration: 170 zl/h net+vat

• Type of contract: B2B

• Duration: Long-term

Summary:

The Senior Scala Developer plays a crucial role in developing data pipelines and managing big data processing in a financial environment, focusing on improving data accessibility and performance.

Main Responsibilities:

The primary duties of the Senior Scala Developer include:

• Develop and optimize Spark jobs for data processing.

• Design and maintain workflows using Oozie and Airflow.

• Manage and optimize Elasticsearch for data search and retrieval.

• Conduct unit and integration testing on Spark jobs.

• Implement CI/CD processes for software delivery.

• Mentor and guide junior developers.

• Communicate technical solutions and collaborate with team members.

Key Requirements:

• 5+ years of experience in Scala, with a strong emphasis on functional programming.

• Expert-level knowledge of Apache Spark (RDDs, DataFrames, DataSets).

• Proficiency in distributed computing concepts.

• Extensive experience in data pipeline orchestration using Oozie and Airflow.

• Solid knowledge of database management and data modeling.

• Experience in CI/CD practices using Bamboo.

• Bachelor's/Master's in Computer Science or related field.

• 3+ years working with big data technologies.

Nice to Have:

• Experience with the Quantexa platform.

• Familiarity with legacy migrations from Oozie to Airflow.

• Knowledge of data governance and security practices.

• Experience with monitoring tools like Prometheus and Grafana.

• Understanding of graph analytics.