Senior Data Engineer

Data

Grzybowska 62, Warszawa

HireOne IT Recruitment

Undetermined

B2B

Senior

Remote

5 580 - 6 975 USD

Net per month - B2B

Tech stack

AWS

master

Big Data

master

SQL

advanced

ETL

advanced

s3

advanced

Job description

Hi geeks!
Will there be a brave ENGINEER that will undertake cooperation with an international company? Hey you! I know it's you!

Check out a few responsibilities and talk about the details with me 🤝

Responsibilities:

Collaborate with product managers, data scientists, data analysts, and engineers to define requirements and data specifications.
Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Airflow, Redshift, EMR.
Develop, deploy, and maintain serverless data pipelines using Event Bridge, Kinesis, AWS Lambda, S3, and Glue.
Define and manage the overall schedule and availability for a variety of data sets.
Work closely with other engineers to enhance infrastructure, improve reliability and efficiency.
Make smart engineering and product decisions based on data analysis and collaboration.
Act as in-house data expert and make recommendations regarding standards for code quality and timeliness.
Architect cloud-based data infrastructure solutions to meet stakeholder needs.

Skills & Qualifications:

Bachelor’s degree in analytics, statistics, engineering, math, economics, computer science, information technology or related discipline.
5+ years professional experience in the big data space.
5+ years' experience in engineering data pipelines using big data technologies (Spark, Flink etc...) on large scale data sets.
Expert knowledge in writing complex SQL and ETL development with experience processing extremely large datasets.
Expert in applying SCD types on S3 data lake using Delta Lake/Hudi.
Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions.
Deep familiarity with AWS Services (S3, Event Bridge, Glue, EMR, Redshift, Lambda)
Ability to quickly learn complex domains and newtechnologies
Innately curious and organized with the drive to analyze data to identify deliverables, anomalies and gaps and propose solutions to address these findings
Thrives in fast-paced startup environment

💰 SALARY: ~ 25 000 pln net/b2b (EUR ~5500 net/b2b (negotiable)
🏖 additional: 20 days fully paid vacations
🏠 type: 100% remote
🤝 contract: B2B

Published: 02.12.2021

Office location

ADVERTISEMENT: Recommended by Just Join IT

Check similar offers

Senior Data Engineer (Spark)

5 860 - 8 907USD/month

6 976 - 8 371USD/month