All offersKrakówDataSenior Data Engineer
Senior Data Engineer
new
Data
HCLTech

Senior Data Engineer

HCLTech
Type of work
Full-time
Experience
Senior
Employment Type
Permanent
Operating mode
Hybrid

Tech stack

    SQL
    advanced
    ETL
    regular
    Data Warehousing
    regular
    Python
    regular
    Hive
    junior

Job description

Responsibilities

• Partner with leadership, engineers, program managers and data scientists to understand data needs.

• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.

• Build data expertise and own data quality for your areas.


Qualifications

• 5+ years Data Engineering experience

• Expert in SQL with good understanding of how relational databases work

• Good Python Programming experience

• Experience with Data Warehousing Architecture

• Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.

• 5+ years experience in custom ETL design, implementation and maintenance

• Experience with data quality and validation.

• Experience with SQL performance tuning and e2e process optimization.

• Experience querying massive datasets using Presto, Hive etc.

Apply for this job

File upload
Add document

Format: PDF, DOCX, JPEG, PNG. Max size 5 MB

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Informujemy, że administratorem danych jest HCL POLAND SP.Z O.O. z siedzibą w 32-080 Krakowie (dalej jako "administrator...more