Data Engineer

DCG is a modern technology company, gathering IT-related professionals in its ranks. Due to the continuous development and the large number of recruitment projects that we carry out for our Partners, we are looking for a person for the position of Data Engineer

• B2B
• 100% Remote work
• The first contract is for 2 months with the possibility of an extension

Description:

The project involves the development of an application designed to manage customer datasets, including product descriptions and sales figures. Alongside this, a robust data lakehouse platform will be built in Databricks to integrate and process data from the application. The platform will transform raw customer datasets into standardized formats to meet mandatory reporting requirements. A dedicated 3-person data team will drive the platform's development, focusing on coding in Spark and Python, designing data flows, gathering business requirements, and ensuring data quality through internal testing

Responsibilities:

• Develop and build an application to manage customer datasets, including product descriptions and sales figures.
• Design and implement a data lakehouse platform in Databricks to process data from the application, transforming raw customer datasets into standardized formats for mandatory reporting purposes.
• Collaborate within a small, agile 3-person data team responsible for developing the data platform.

Key responsibilities include:

• Coding in Spark and Python.
• Designing and creating data flows.
• Gathering and understanding business requirements.
• Conducting internal testing and ensuring data quality.

Requirements:

• 8+ years of experience in data engineering, demonstrating deep technical expertise.
• At least 2 years of hands-on experience working with Databricks.
• Strong interpersonal skills, with the ability to communicate effectively and build relationships quickly.
• Proactive and self-motivated, with a results-driven approach.
• Experience in Spark, Python, PySpark, Databricks, Unity Catalog, Delta Live Tables
• Fluency in English is essential, as the role involves collaboration with UK-based teams.
• Polish language skills are optional but highly valued.