Azure Data Engineer

We are looking for a talented and motivated Data Engineer specializing in Azure to join our data engineering team! The ideal candidate should have a strong background in SQL and experience with at least one programming language. Additionally, familiarity with DevOps practices, particularly CI/CD pipelines, is essential. This role involves designing, developing, and optimizing scalable data pipelines and storage solutions, working collaboratively with cross-functional teams to meet business needs.

REQUIREMENTS

• Proven experience as a Data Engineer with a focus on Azure services (e.g., Azure Data Factory, Azure SQL Database, Azure Synapse) or similar technologies.
• Strong SQL skills, including complex query development, optimization, and troubleshooting.
• Proficiency in at least one programming language, such as Python, C#, or Scala.
• Experience with DevOps practices, including version control, automated testing, and CI/CD pipelines.
• Familiarity with cloud-based data storage and processing (Azure Data Lake, Databricks, etc.).

RESPONSIBILITIES

• Design, develop, and maintain efficient data pipelines and workflows.
• Develop SQL-based solutions for data transformation, extraction, and loading (ETL) processes.
• Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements and provide optimized solutions..
• Manage and optimize data storage solutions, including data lakes and warehouses.
• Troubleshoot data-related issues and ensure the accuracy and integrity of data across all systems.

Nice to have

• Experience with Snowflake data platform.
• Experience with CosmosDB and ElasticSearch is a plus.
• Azure Data Engineer certification is a plus.
• Knowledge of data governance and security best practices in cloud environments.
• Familiarity with data modeling and data warehousing concepts.