Data Engineer with Airflow

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities:

• Participate in the migration process from Tableau Prep to Airflow, ensuring a seamless and efficient transition
• Develop, maintain, and optimize data pipelines and workflows using Python and Airflow
• Write and optimize complex SQL queries for large datasets, including joins and window functions, to support data transformation and reporting needs
• Collaborate closely with data engineers and analysts in a Kanban environment to ensure the quality and reliability of data solutions
• Ensure proper documentation of data workflows, processes, and pipelines to facilitate team collaboration and maintenance
• Troubleshoot and resolve issues related to data workflows, pipelines, and integrations
• Implement best practices for data management, pipeline optimization, and performance tuning

Requirements:

• Proficiency in Python with a strong focus on data engineering workflows
• Advanced knowledge of SQL, including experience with large joins and window functions
• Hands-on experience with Airflow for orchestrating workflows and data pipelines
• English proficiency at C1 or higher for effective communication in an international team
• Ability to perform live coding during the recruitment process (Python and SQL)
• Experience working with Snowflake or similar cloud-based data warehouses
• Familiarity with DBT (Data Build Tool) for transforming data in warehouses
• Experience with AWS S3 or other cloud storage solutions

Offer:

• Private medical care
• Co-financing for the sports card
• Training & learning opportunities
• Constant support of dedicated consultant
• Employee referral program