Cloud Data Architect

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support.

Responsibilities:

• Manage and design cloud infrastructure using Microsoft Azure, ensuring effective utilization of Azure’s data-related components
• Implement and oversee networking and authorization configurations in the Azure environment
• Work with Azure Synapse, particularly Synapse Serverless and Synapse Pipelines, to enable efficient data processing and analytics
• Develop and manage Databricks workflows, including DLT Pipelines and administrative tasks
• Design, implement, and optimize Data Lakehouse architectures and ensure integration with Azure services
• Apply Medallion Architecture principles and implement metadata-driven ETL processes for streamlined data flow
• Write and optimize Python code for data processing tasks, ensuring high-performance solutions
• Design and develop Apache Spark workflows, focusing on scalability and optimization
• Create and optimize SQL queries, manage SQL Server databases, and integrate with cloud services
• Design, implement, and manage ETL/ELT processes to ensure the effective integration of large datasets
• Apply best practices in data warehouse design and data architecture for efficient storage and access to data
• Develop and implement CI/CD pipelines for Synapse, Databricks, and other Azure services to ensure smooth deployment and automation
• Utilize Power BI to create insightful reports and visualizations based on data analysis
• Manage source code using GIT and Azure DevOps, following best practices for branching and version control
• Demonstrate excellent communication and interpersonal skills, fostering collaboration within cross-functional teams
• Lead engineering teams and oversee the delivery of technical projects, ensuring alignment with business goals
• Collaborate with business stakeholders to define requirements and deliver appropriate technological solutions

Requirements:

• In-depth knowledge of the Microsoft Azure environment, including Azure Infrastructure (data-related components), networking and Authorization in Azure, management and design of cloud infrastructure
• Knowledge and experience with data platforms: Azure Synapse (especially Synapse Serverless and Synapse Pipelines)
• Experience with Databricks (including DLT Pipeline, Workflows, and Administration) and Data Lakehouse and its architecture
• Strong understanding of Medallion Architecture and experience in implementing metadata-driven ETL processes to optimize data workflows and governance
• Experience as a Lead Engineer
• Proficiency in Python
• Expertise in Apache Spark
• Ability to create and optimize SQL queries, manage databases, and perform data manipulation and extraction effectively
• Proficiency in designing and implementing ETL / ELT processes
• Proven experience in developing and implementing Continuous Integration and Continuous Delivery (CI/CD) pipelines for data platforms like Synapse, Databricks, and other services
• Power BI Expertise
• Experience in designing scalable, custom solutions and data platforms tailored to specific business requirements
• Solid knowledge of version control practices using GIT and experience managing branching strategies in Azure DevOps
• Strong communication and interpersonal skills
• Collaborating with business stakeholders to deliver appropriate technological solutions

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant
• Employee referral program