Data Engineer( GCP, Terraform)

Summary:

The primary objective of this role is to spearhead a data migration project focused on transferring data pipelines from a third-party orchestration tool to native Google Cloud Platform (GCP) services. The ideal candidate should possess 5+ years of experience as a Data Engineer with strong competencies in Google Cloud Platform, Python, and Terraform.

Main Responsibilities:

• Design and implement the data migration architecture.

• Establish infrastructure representation using Terraform.

• Select, configure, and manage an orchestrator.

• Implement reliable CI/CD practices for testing and deployments.

• Migrate data pipelines to the GCP environment and validate performance.

• Onboarding a new full-time employee.

Key Requirements:

• At least 5 years of experience as Data Engineer.

• Proven experience with Google Cloud Platform (GCP).

• Proficiency in Python and SQL for pipeline development.

• Hands-on expertise with Terraform as an infrastructure-as-code tool.

Nice to Have:

• Experience with DBT (Data Build Tool).

• Previous migration experience of data pipelines from tools like Twirl to Composer.

• Understanding of CI/CD best practices in data projects.