Ingestion Data Engineer

Join us, and build the data pipelines powering global innovation!

Kraków - based opportunity with hybrid work model (6 days/month in the office).

As an Ingestion Data Engineer, you will be working for our client, a global financial institution leading a large-scale digital transformation to modernize its data infrastructure and analytics capabilities. You will be part of a dynamic engineering team building and optimizing scalable data ingestion pipelines across cloud and on-premise environments. In this role, you are ensuring smooth data flow from multiple sources into analytical platforms, supporting advanced data processing, and implementing best practices in automation and DevOps. You are contributing to high-impact projects that enhance data accessibility and decision-making across the organization.

Your main responsibilities:

• Designing and developing large-scale data ingestion and processing pipelines

• Implementing and maintaining data solutions using Hadoop, Hive, Spark, and Scala

• Managing data workflows using Airflow and Jenkins for automation and orchestration

• Collaborating with cross-functional teams to define and deliver scalable data architectures

• Deploying data solutions on Google Cloud Platform services such as BigQuery and DataProc

• Ensuring data quality, reliability, and consistency across ingestion processes

• Performing unit and integration testing as part of automated CI/CD pipelines

• Troubleshooting and optimizing data performance and scalability issues

• Maintaining version control and deployment workflows using Git and Jenkins

• Supporting Agile delivery by participating in sprints, reviews, and retrospectives

You’re ideal for this role if you have:

• 5+ years of experience in data engineering or related roles

• Strong expertise with Hadoop, Hive, HDFS, Apache Spark, and Scala

• Proven experience with Google Cloud Platform data services such as BigQuery and DataProc

• Solid understanding of SQL and relational database technologies

• Experience designing and deploying distributed data processing systems

• Familiarity with CI/CD tools like Jenkins and orchestration tools like Airflow

• Hands-on experience with version control tools such as Git or GitHub

• Understanding of data modeling techniques using relational and non-relational approaches

• Knowledge of Agile and DevOps methodologies

• Strong interpersonal skills and ability to work in global, cross-functional teams

It is a strong plus if you have:

• Google Cloud Certification (e.g., Professional Data Engineer)

• Experience with data migration and transformation in cloud environments

• Exposure to Tableau or other BI tools for visualization

• Experience with Cloud Composer, Dataflow, or Pub/Sub

• Understanding of cloud design patterns and architecture best practices

We offer you:

ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious and driven people. The offer includes:

• Stable and long-term cooperation with very good conditions

• Enhance your skills and develop your expertise in the financial industry

• Work on the most strategic projects available in the market

• Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years

• Participation in Social Events, training, and work in an international environment

• Access to an attractive Medical Package

• Access to Multisport Program

#GETREADYInternal job ID #7971

📌You can report violations in accordance with ITDS’s Whistleblower Procedure available here.