Data Engineer

contract: B2B
salary: 170 pln/h + VAT

mode: 60% from the office, Gdańsk
domain: banking

We are seeking a Data Engineer to join a regulatory-driven initiative aimed at delivering new reporting solutions related to the Finnish National Land Survey and Positive Credit Register. The ideal candidates will possess strong data engineering and distributed data processing skills, with an ability to translate complex business requirements into efficient SQL statements.

Main Responsibilities

• Develop data engineering solutions for regulatory reporting needs.

• Translate business requirements into executable SQL statements.

• Provide Level 3 support and collaborate with Production Assurance.

• Optimize data processing workflows using Apache Hadoop and Spark.

• Implement CI/CD pipelines for seamless deployment.

• Utilize Kafka for building event-driven architectures.

Key Requirements

• Strong experience in data engineering and distributed data processing.

• Proficient in SQL for data transformation and reporting.

• Hands-on expertise with Apache Hadoop and Apache Spark.

• Experience with Workflow orchestration tools such as Oozie and Airflow.

• Familiarity with CI/CD pipelines using Git, PR workflows, and Jenkins.

• Knowledge of Kafka and event-driven architectures.

• Good communication skills and the ability to translate SQL issues for business stakeholders.

Nice to Have

• Experience with containerization and orchestration using Kubernetes.

• Familiarity with Apache Flink.