All offersŁódźDataSenior Data Engineer - Big Data
Senior Data Engineer - Big Data
Data
Commerzbank

Senior Data Engineer - Big Data

Commerzbank
Łódź
Type of work
Full-time
Experience
Senior
Employment Type
Permanent
Operating mode
Hybrid

Tech stack

    Cloud
    advanced
    IaC
    advanced
    CI/CD
    regular
    Python
    regular
    SQL
    regular

Job description

Online interview
Friendly offer

📢 Join our team as a Senior Data Engineer! 📢


As a Senior Data Engineer you will work in the team that is responsible for all cross-cutting cloud/Hadoop topics in the Big Data & Advanced Analytics key area. You will be in charge of cloud and data engineering in the cloud migration and development of cloud-native applications, mentoring others in technical concepts and implementing best practices for our Cloud-based data ingestion solutions. Furthermore, in your role you will be responsible for the investigation, preparation and migration of our Products from our On-Premise infrastructure to the Cloud native (GCP and Azure).

A dynamic and representative working environment in a collegial atmosphere and attractive benefits ensure that you feel at home from the start.


What you will be doing? 👇

  1. Working in a task orientated and Test Driven Team to investigate our Product and choose the candidates for On-Premise to Cloud migration
  2. Implement and maintain cloud-native landing and solutions
  3. Develop future-proof software solutions to Connect cloud and on-premise and viseversa
  4. Integrate security standards, policies and controls into service offerings


Alternative tasks:

  1. Focusing on stability, performance tuning and innovation of the applications
  2. Coaching colleagues and end users, actively contributing to knowledge sharing and to a learning culture


Which technology & skills are important for us? 👌

  1. Cloud Data Development:
  2. Design and develop cloud-based data storage solutions using Google Cloud Platform services such as Cloud Composer, Dataproc, Dataflow and Pub/Sub
  3. Build and maintain data pipelines to ensure data accuracy, consistency, and real-time processing
  4. Optimize data infrastructure for performance, scalability and reliability
  5. Infrastructure as Code (IaC):
  6. Utilize Terraform to create and manage cloud resources efficiently
  7. Implement CI/CD pipelines for automated deployment and continuous integration
  8. Microservices and API:
  9. Work with microservices architecture and design APIs for seamless data integration
  10. Scripting and Testing:
  11. Proficient in Python and SQL for ETL processes, schema evolution pipeline development and performance tuning
  12. Develop, test, and deploy solutions using Dataproc, Dataflow, and Cloud Functions
  13. Scala Expertise:
  14. Leverage Scala for Dataproc pipeline development, enhancement and performance tuning


How?

📌 Hybrid on Wersalska 6 street (two days per week)


Below you can find more information about cluster and Commerzbank.

The Big Data cluster is the enabler for data scientists and provides a huge collection of data and a data science workbench in one place.

  • BI technology within the lake infrastructure
  • Establish a stable, state-of-the-art technology base with on-prem and cloud solutions
  • Set up data lake as single data and analytics hub and effectively ingest most important data sources
  • Establish data quality and metadata management
  • Provide Data Marts and sandboxes for segments and functions with the most important combination of data sources


Commerzbank is a leading international commercial bank with branches and offices in almost 50 countries. The world is changing, becoming digital, and so we are. We are leaving the traditional bank behind us and are choosing to move forward as a digital enterprise. This is exactly why we need talented people who will join us on this journey. We work in inter-locational and international teamwork in agile methodologies.


What we offer? 🥳

Of course, we offer Development Plans for employees Life insurance, flexible working hours, integration events and much more 😎

Important! Please add the clause to your CV. 📑 You can find it on the end of the advert.