Responsibilities
• Partner with leadership, engineers, program managers and data scientists to understand data needs.
• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.
• Build data expertise and own data quality for your areas.
Qualifications
• 5+ years Data Engineering experience
• Expert in SQL with good understanding of how relational databases work
• Good Python Programming experience
• Experience with Data Warehousing Architecture
• Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.
• 5+ years experience in custom ETL design, implementation and maintenance
• Experience with data quality and validation.
• Experience with SQL performance tuning and e2e process optimization.
• Experience querying massive datasets using Presto, Hive etc.
Informujemy, że administratorem danych jest HCL POLAND SP.Z O.O. z siedzibą w 32-080 Krakowie (dalej jako "administrator...more