Data Architect

Data Architect

As a Data Architect, you will be responsible for designing, developing, testing, and deploying robust data pipelines and platforms utilizing AWS services. Your expertise will guide the implementation and maintenance of data lake, lake house, or data mesh architectures, facilitating collaboration with data engineers, analysts, and DevOps teams to deliver comprehensive business solutions. You will ensure adherence to data governance, security, and records management policies while troubleshooting and resolving data-related issues effectively.

Main Responsibilities

• Design and develop scalable data pipelines and architectures.

• Implement and maintain data lake, lake house, or data mesh architectures.

• Collaborate with cross-functional teams to deliver data-driven business solutions.

• Ensure compliance with data governance and security policies.

• Troubleshoot and resolve data-related issues.

• Maintain ownership of projects from inception to delivery.

Key Requirements

• Minimum of 5+ years of experience in cloud technology.

• In-depth understanding of various data tools and when to implement them.

• Proficiency in Spark/Scala, Python, and SQL.

• AWS expertise, particularly in services such as S3, Glue, Athena, EMR, EC2, and Lambda.

• Experience in ETL design and data modeling.

• Strong analytical thinking, problem-solving skills, and attention to detail.

• Ability to learn and develop comprehensive knowledge of end-to-end processes.

Nice to Have

• Familiarity with CI/CD tools (e.g., GitHub Actions).

• Experience with table formats like Apache Iceberg.

• Exposure to data quality frameworks such as Great Expectations or Deequ.

• Knowledge of Bash and HCL is advantageous.

Other Details

This role offers a flexible remote working arrangement. The selected candidate will work in a dynamic environment where they can apply their expertise to impactful projects, contributing to innovative data solutions.