Senior Data Engineer

Responsibilities

• Partner with leadership, engineers, program managers and data scientists to understand data needs.

• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.

• Build data expertise and own data quality for your areas.

Qualifications

• 5+ years Data Engineering experience

• Expert in SQL with good understanding of how relational databases work

• Good Python Programming experience

• Experience with Data Warehousing Architecture

• Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.

• 5+ years experience in custom ETL design, implementation and maintenance

• Experience with data quality and validation.

• Experience with SQL performance tuning and e2e process optimization.

• Experience querying massive datasets using Presto, Hive etc.