Industry: Banking
Location: Hybrid, Warszawa, Gdynia or Gdańsk (min. 1x a week in the office)
Rate: Up to 180PLN/h
Start: ASAP (flexible)
Project duration: > 12 months
emagine is searching for a talented Senior Data Engineer/ETL Designer to optimize data workflows and manage hybrid cloud infrastructures. The ideal candidate will possess strong scripting skills in languages such as Python and SQL and should be able to design robust ELT pipelines. Join us and elevate your career with emagine.
- Designing, building, and maintaining scalable ELT pipelines.
- Develop and optimize PLSQL queries for high-performance data storage in Oracle.
- Write Python-based data engineering scripts for data processing.
- Implement CI/CD pipelines for data infrastructure and workflow automation.
- Manage database change management processes.
- Collaborate with major cloud vendors for hybrid infrastructures.
- Integrate and oversee modern data stacks.
- Monitor, debug, and optimize data workflows and infrastructure performance.
- Ensure compliance with data quality and governance standards.
- Proficiency in designing OLAP systems and utilizing STAR schema or denormalization techniques.
- Strong skills in Python and PLSQL.
- Experience in ELT/ETL development using tools like IBM Datastage or Azure Data Factory.
- Database management experience in Oracle, MSSQL, Snowflake.
- Familiarity with DevOps practices, including Git and Docker.
- Knowledge of Tools for CI/CD pipeline development, such as Jenkins or Azure DevOps.
- Experience in testing automation with tools such as Robot or Selenium.
- Understanding of workflow orchestration tools like Airflow and Prefect.
- Experience with streaming and batch processing technologies like Kafka.
- Familiarity with distributed computing solutions, e.g., Spark or Flink.
- Knowledge of data governance and compliance (RBAC, GDPR, HIPAA).