Senior Data Engineer
ING Hubs Poland
For over 20 years we have been taking up challenges and proving that we are a trustworthy partner supporting ING in digital transformation. We are the unseen heroes providing the people of the bank with the essential — and often unnoticed — services. We also protect their money and simply create the future of banking. And that's a big thing! See what exactly we do at ING Hubs Poland!
Tech stack
Data Pipelines
Apache Airflow
Apache Spark
Python
Data stores
Object storage services
Docker
Kubernetes
CI/CD
Job description
We are looking for you, if you:
- have hands-on experience building complex data pipelines,
- have experience with Apache Airflow, Spark, Python,
- have experience in setting up and optimizing both SQL and noSQL data stores (MS-SQL, Hive), as well as familiarity with object storage services (e.g., S3),
- have experience with deployment and provisioning automation tools (e.g., Docker, Kubernetes, CI/CD).
You'll get extra points for:
- experience working in cloud environment (e.g., Azure DevOps, GCP),
- Extensive experience with Spark, Hadoop, SQL & relational databases, data models and ETL pipelines
- experience in building GitLab CICD pipelines
- experience in managing and further developing distributed systems and clusters for batch processing,
- knowledge of MLOps architecture and practices,
- Experience with modern data modeling concepts and large scale data warehousing architecture.
Your responsibilities:
Your passion is to work with the latest concepts and technologies in the field of Data Engineering. As an engineer, you will be responsible to design and build the data pipelines for one of many use cases catering stakeholder requirements such as which clients have the worst carbon emission footprint – so ING can decide to discontinue doing business with them, collaborate with the data analysts and UX researchers to create the best user experience and insights for our users. Your day-to-day activities can look like this: implementing new features in Kedro/PySpark, testing them in Apache Airflow, deploying it in our in-house platform running on Kubernetes, as well as optimizing the data in the permanent data store.
Information about team:
The Wholesale Banking Advanced Analytics team is a team of 100+ people that has the mission to make Wholesale Banking in ING data-driven. We do this by combining UX research and engineering with data science to deliver high-value solutions and products for our organization. We work in a fun and creative environment, and we’re dedicated to bringing out the best in both each other and our projects. We have offices in Amsterdam (main office), Warsaw, Katowice, Bucharest and Manila.
The role naming convention in the global ING job architecture will be “Engineer IV”.
Permanent
Check similar offers
