Tech Lead (Databricks | Azure | PySpark)

Tech Lead (Databricks | Azure | PySpark) - Praca Hybrydowa- Warszawa

We’re building a team to bring structure and clarity to how data work is planned and delivered - and we’re looking for someone who enjoys process thinking and cross-team collaboration.

We are looking for:

A Tech Lead with strong hands-on Data Engineering experience in Databricks on Azure, who can design and optimize data pipelines and lead delivery in a distributed team setup.

Apply if you have:

• 5+ years of experience as a Data Engineer (or similar)

• 2+ years in a Tech Lead role (technical leadership, guiding solutions, supporting the team)

• Strong PySpark skills (distributed processing - not only Pandas)

• Hands-on experience with Databricks, including:

  • Environment & compute configuration

  • Lakeflow Declarative Pipelines

  • Asset Bundles and CI/CD

• Understanding and practical use of Medallion Architecture

• Experience with Azure, e.g. Key Vault, Azure SQL, ADF (and similar services)

• English - must have (US-based client)

Nice to have:

• Experience in insurance or finance

• Consulting background

• Data modeling experience

You'll be joining...

A project for a large US insurance client. The work focuses on introducing and optimizing data flows between the client’s insurance core system and Databricks - improving reliability, performance, and overall data platform structure.