Senior Data Engineer
Data
Senior Data Engineer
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Tech stack
AWS
Big Data
SQL
ETL
s3
Job description
Online interview
Hi geeks!
Will there be a brave ENGINEER that will undertake cooperation with an international company? Hey you! I know it's you!
Check out a few responsibilities and talk about the details with me 🤝
Responsibilities:
Will there be a brave ENGINEER that will undertake cooperation with an international company? Hey you! I know it's you!
Check out a few responsibilities and talk about the details with me 🤝
Responsibilities:
- Collaborate with product managers, data scientists, data analysts, and engineers to define requirements and data specifications.
- Develop, deploy and maintain data processing pipelines using cloud technology such as AWS, Kubernetes, Airflow, Redshift, EMR.
- Develop, deploy, and maintain serverless data pipelines using Event Bridge, Kinesis, AWS Lambda, S3, and Glue.
- Define and manage the overall schedule and availability for a variety of data sets.
- Work closely with other engineers to enhance infrastructure, improve reliability and efficiency.
- Make smart engineering and product decisions based on data analysis and collaboration.
- Act as in-house data expert and make recommendations regarding standards for code quality and timeliness.
- Architect cloud-based data infrastructure solutions to meet stakeholder needs.
Skills & Qualifications:
- Bachelor’s degree in analytics, statistics, engineering, math, economics, computer science, information technology or related discipline.
- 5+ years professional experience in the big data space.
- 5+ years' experience in engineering data pipelines using big data technologies (Spark, Flink etc...) on large scale data sets.
- Expert knowledge in writing complex SQL and ETL development with experience processing extremely large datasets.
- Expert in applying SCD types on S3 data lake using Delta Lake/Hudi.
- Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions.
- Deep familiarity with AWS Services (S3, Event Bridge, Glue, EMR, Redshift, Lambda)
- Ability to quickly learn complex domains and newtechnologies
- Innately curious and organized with the drive to analyze data to identify deliverables, anomalies and gaps and propose solutions to address these findings
- Thrives in fast-paced startup environment
💰 SALARY: ~ 25 000 pln net/b2b (EUR ~5500 net/b2b (negotiable)
🏖 additional: 20 days fully paid vacations
🏠 type: 100% remote
🤝 contract: B2B
Check similar offers
