Data Engineer

Certification:

Certifications such as Certified Amazon Web Services (AWS) Solutions Architect, and AWS Certified Data Analytics Specialty are highly desirable.

Skills Set

Required:

• Expert knowledge and experience developing and implementing ETL jobs for data warehouses using SQL and Python.
• Good knowledge of software development language and tools such as SQL, Python, Spark
• Good knowledge and experience with AWS or Azure Big Data tools: Glue, Athena, Redshift, Kinesis, Data bricks, azure analytics, Data explorer.
• Good knowledge and experience with cloud-based storage and functions. (S3, Blob, Lambda, Azure Functions)
• Expert knowledge and experience of data engineering tools and methodologies (Datawarehouse, data lake, star schema).
• Good knowledge and experience with AWS Cloud Formation or Terraform.
• Knowledge of CI/CD concepts in general and AWS Code Pipeline/ Code Build/ Code Deploy in particular.
• Knowledge of provisioning of data APIs.
• Knowledge of information security concepts and terminology
• Excellent written and verbal communication skills that are compelling, convincing and reassuring, with the ability to articulate complex technical ideas to non-technical team.
• Proficient user of Git. Familiarity with Jira and Bitbucket.
• Experience in the implementation of, or demonstratable familiarity with the Gartner ODM framework would be an advantage.