Data Architect - Databricks Platform

Are you passionate about Infrastructure as Code (IaC) and ready to take Databricks automation to the next level? We're looking for a Data Architect - Databricks Platform to design, implement, and automate Azure Databricks environments, focusing on workspace provisioning, infrastructure automation, and Unity Catalog integration. While your main mission will be building and managing scalable Databricks environments, a solid understanding of data processing (ETL/ELT) in Databricks will be a strong plus. If you have experience with Terraform, Python, and have worked with Apache Spark or Databricks, we’d love to hear from you!

Your responsibilities

• Design, implement, and automate Databricks environments using Terraform and Databricks API
• Manage and integrate multiple Databricks workspaces into Unity Catalog for centralized governance
• Automate infrastructure provisioning and configuration to enable seamless scalability and security
• Optimize cluster deployment and resource management 
• Implement and enforce security policies (RBAC, ACLs, Unity Catalog) to ensure compliance
• Develop YAML-based CI/CD pipelines for Databricks infrastructure deployment
• Collaborate with Data Architects and DevOps to improve automation and governance strategies
• Monitor and troubleshoot infrastructure-related issues in Databricks environments

We are looking for

• 3+ years of experience in data engineering (preferably in a consulting model)
• Hands-on experience with Infrastructure as Code (IaC) - Terraform is a must
• Experience working with Apache Spark / Azure Databricks
• Strong Python skills 
• Experience with Unity Catalog and workspace governance
• Proficiency in Databricks REST API
• Experience with CI/CD pipelines (Azure DevOps, GitHub Actions) 
• Knowledge of Azure services, including Azure Data Lake Storage (ADLS), Key Vault, and Databricks CLI
• Strong communication and collaboration skills to work with both technical and non-technical stakeholders
• Ownership mindset and proactive, client-oriented approach
• Fluency in English and Polish

Nice to have:

• Experience with data processing in Databricks
• Certificates: Solutions Architect Champion or Databricks Platform Administrator

We offer

• Free UNUM health insurance – up to 350 000PLN (advanced 500 000PLN)
• Co-fundating for the PZU, Medicover or LuxMed medical package
• Multisport card
• Access to training platforms (MS certificates, SQL BI, Udemy, internal Delivery Excellence Workshops)
• Possibility: 100% remotely work/ hybrid work / work in office
• Flexible working hours
• Simple breakfasts, fruit and snacks in our office
• Always chilled beverages in our office
• Program "It's good to stay with us" - a voucher of PLN 2 500 for an employee with 3-year seniority for any purpose
• Paid referral system - get up to PLN 8000 for referring an employee
• A small gift on each anniversary of work at Clouds on Mars
• Quarterly budgets for integration
• Free parking spot