Data Engineer/Analyst - Remote!

Join us, and develop your data competencies

Opportunity with the possibility to work 100% remotely!

As a Data Engineer/Analyst, you will be working for our client, a dynamic and rapidly expanding organization in the home and lifestyle sector. The client is embarking on an exciting project to build and optimize their data infrastructure to gain deeper insights into customer behavior and drive business growth. You will play a pivotal role in designing and implementing robust ETL/ELT pipelines, leveraging cutting-edge technologies to transform raw data into actionable intelligence. Your expertise will be crucial in shaping the future of their data-driven decision-making processes and contributing to the overall success of the company.

Your main responsibilities:

• Design and implement ETL/ELT pipelines
• Work with Apache Spark, understanding cluster operation and resource management
• Configure the number of executors, memory, and partitions in Spark
• Utilize strong SQL skills for data manipulation and querying
• Apply understanding of data warehouse concepts and data modeling basics
• Build and monitor data flows using a data orchestration tool
• Employ practical knowledge of Python to write functions and work with data structures
• Create basic ETL processes involving reading, transforming, and writing data
• Work with a cloud platform for data storage and processing
• Apply basic knowledge of Git and understanding of CI/CD concepts

You're ideal for this role if you have:

• 2 years of experience in designing and implementing ETL/ELT pipelines
• Knowledge of Apache Spark, including cluster operation
• Understanding of Spark resource management
• Good knowledge of SQL
• Understanding of data warehouse concepts and data modeling basics
• Knowledge of any data orchestration tool
• Practical knowledge of the Python language
• Experience working with a cloud platform
• Basic knowledge of Git
• Practical knowledge of Power BI