Senior Data Engineer/ Data Platform Architect

Project description:

Due to the planned expansion of the team working on building a corporate Data Warehouses / Data Lakehouse in Azure Cloud for one of the largest retail clients in Poland, we are looking for a Senior Data Engineer/Data Platform Architect to join us in this project. Additionally, we aim to strengthen the internal Microsoft Competence Center team around Data on Azure Cloud.

Responsibilities:

• Collaborate with our in-house team to architect, design, and implement scalable data platform for domain-specific data assets on Azure Cloud;
• Define and document best practices and strategies for data management, integration, and performance optimization;
• Deep understanding of data modeling, ETL processes, data warehousing concepts, and big data technologies;
• Develop and maintain data pipelines using Azure Data Factory and Databricks;
• Utilize Azure Synapse Analytics, Azure Data Lake Storage (ADLS), and Azure SQL Database for data storage and processing;
• Ensure the data platforms are optimized for performance and reliability;
• Assist in integrating diverse data sources into the Azure-based data platform, ensuring data consistency and quality;
• Implement data governance and security measures using Azure Purview and Azure Key;

Requirements:

• Proficiency in T-SQL - competence in designing and optimizing complex SQL queries;
• Experience in implementing Data Platforms/ Data Warehouse / Data Lakehouse architecture;
• Experience in working with technologies such as Azure Data Factory, Azure Synapse, Azure Databricks, Microsoft Fabric, SQL Server;
• Experience in working with large data volumes;
• Senior practical experience in development of and knowledge of relational databases, especially MS SQL;
• Experience in working with Microsoft Power BI, PowerApps, PowerAutomate, Logic Apps;
• Experience in implementing Databricks Unity Catalog for the purpose of centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces;
• Experience in configuration and optimization of database engines;
• Experience in end-to-end of data warehouse implementation;
• Experience with data modeling, ETL processes, and data warehousing concepts;
• Proficiency in the Polish and English languages due to work with international team;
• Strong analytical skills;
• Effective communication and collaboration skills;

We offer:

👨‍💻 Collaboration in a team of interdisciplinary experts and technology enthusiasts inspired by working in a flat hierarchy;

📈 Permanent full-time cooperation in an extraordinary company that has been growing rapidly for 20 years;

🚀 A chance to grow in a variety of IT projects for very well-known and recognizable clients-leaders in their industries;

🥇 Opportunity to work with the latest technologies based on the highest development standards;

⌚️ Flexible time and hybrid or fully remote working model (different teams have different arrangements, we do not impose any options);

☁ A number of initiatives to support knowledge sharing and development, such as: internal training, topic guilds, Cloud training and certification opportunities (technology partnerships in the four clouds);

📣 Opportunities to learn English or German online and team English lessons;

🏋️‍♂️ Opportunity to join Multisport and medical insurance;

⛵️ Maritime adventures - with us you will sail in the Caribbean, Mediterranean or North Sea (participation in company cruises is subsidized by the company).