Introduction & Summary
We are seeking a Microsoft Fabric Data Engineer with over 7 years of relevant experience to spearhead the architecture and development of a scalable, cloud-native data platform utilizing Microsoft Azure. The ideal candidate will be instrumental in integrating data from various enterprise systems, such as SAP BW, SAP HANA, Labware, ELN, and Salesforce, to establish a cohesive and intelligent enterprise data ecosystem, enhancing analytics and AI-driven insights across diverse business domains.
Main Responsibilities
The Data Engineer will be responsible for:
- Designing and implementing automated data pipelines integrating multiple enterprise systems.
- Developing efficient data models across domains for analytics.
- Ensuring strong governance, security, and optimized performance.
- Documenting processes and knowledge transfer to ensure sustainability.
- Delivering clean and structured datasets for BI and AI/ML models.
Key Requirements
- Proficiency in Microsoft Fabric (MS Fabric)
- Expertise in Python and SQL
- Experience with Azure Functions
- Skills in Apache Kafka
- Knowledge of Docker Containers
- Capability in Data Modeling (Dimensional & Relational)
- Experience in Multi-Source Data Integration (SAP BW, SAP HANA, Labware, ELN, Salesforce, etc.)
- Understanding of Event-Driven Architecture and Real-Time Data Processing
- Insight into Data Governance and Security
- Familiarity with CI/CD and GitHub
Nice to Have
- Proven experience in Azure Data Engineering and cloud-native architectures.
- Solid experience with MS Fabric, Azure Functions, Kafka, and Docker.
- Comprehensive knowledge of data modeling, ETL/ELT processes, and performance tuning.
- Familiarity with SAP BW and SAP DataSphere for effective source integration.
- Demonstrated ability to work independently and deliver comprehensive solutions.
Other Details
This position requires hybrid working—3 days a week in office, based in Koregaon Park Pune. Timezone: CET.