Senior Data Engineer

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Senior Data Engineer

Responsibilities:

• Work with various clients globally, delivering software systems and best practices for scalable and robust solutions.
• Engineer data platforms for scale, performance, reliability, and security.
• Integrate data sources and optimize data processing.
• Proactively address challenges, resolve blockers, and drive effective communication across distributed teams.
• Continuously seek opportunities to enhance data systems and ensure alignment with evolving business needs.
• Onboard and mentor new engineers for clients and internal teams

Requirements:

• 5+ years in a senior developer role, with hands-on experience in building data processing pipelines
• Proficiency with GCP services, especially BigQuery and BigQuery SQL, for large-scale data processing and optimization
• Extensive experience with Apache Airflow, including DAG creation, triggers, and workflow optimization
• Knowledge of data partitioning, batch configuration, and performance tuning for terabyte-scale processing
• Strong Python and/or Scala proficiency, with expertise in modern data libraries and frameworks (e.g., Databricks, Snowflake, Spark, SQL)
• Experience with unit testing, pre-commit checks, and strict type enforcement for data pipelines
• Deep understanding of relational and NoSQL databases, data modelling, and data warehousing concepts
• English level: B2, C1

Nice to have:

• Expertise in optimizing BigQuery performance using tools like Query Profiler and addressing compute resource bottlenecks
• Prior experience developing or testing custom operators in Apache Airflow
• Familiarity with Docker, Kubernetes, Helm, Terraform, Kafka, and CI/CD pipelines for data environments

Offer:

• Private medical care
• Co-financing for the sport card
• Training & learning opportunities
• Constant support of dedicated consultant
• Employee referral program