Data Lake Developer
Data
Data Lake Developer
Warszawa
Type of work
Undetermined
Experience
Mid
Employment Type
B2B
Operating mode
Remote
Tech stack
ETL
SQL
BI Technologies
Python
Hadoop
Spark
Azure
Linux/Unix
Java
Agile
Job description
Online interview
Our client, a global leader in next-generation digital services and consulting is currently seeking Data Lake Developer to be based remotely, but within Eastern Europe.
As Data Lake Developer you will be collaborate with programmers and designers for conceptualizing and developing new reports, maintaining and updating existing reports as needed, designing and implementing processes, as well as perform complex data analysis to assess existing business systems and procedures.
As Data Lake Developer you will be collaborate with programmers and designers for conceptualizing and developing new reports, maintaining and updating existing reports as needed, designing and implementing processes, as well as perform complex data analysis to assess existing business systems and procedures.
Job Responsibilities
- Collaborate with internal data scientists, data analysts, and data engineers as well as external resources to build scalable solutions for data acquisition, storage, and processing.
- Monitoring the enterprise data flow into the central data lake.
- Implementation and integration of data flows and data modeling.
- Develop and maintain automated ETL pipelines for big data using scripting languages.
- Writing complex, highly optimized SQL queries.
- Experience with developing machine learning models & retraining systems.
Technical Skills
- Bachelor’s Degree in a technical field or relevant work experience.
- Minimum 4-5 years of experience in Data Warehouse and ETL framework.
- Strong background in data warehouse design (e.g. dimensional modeling) and data mining.
- In-depth understanding of relational databases (SQL) and ETL (Extract, transform, load) frameworks.
- Experience scaling production databases with query indexing, optimization, and performance tuning.
- Familiarity with BI technologies (e.g. Microsoft Power BI).
- Experience with Python, Hadoop, Spark, MS Azure, Linux/Unix, and Java.
- Experience with agile methodology and project management.
- Familiarity with analytics, optimization, and machine learning techniques.
Check similar offers
