Lead Data Engineer

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.

Avanade website; Privacy policy

This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As a Lead Data Engineer, you will guide Avanade Data Engineering teams in building modern Data & AI solutions. You’ll work with clients from various domains and industries, being exposed to Microsoft technologies and AI solutions. Beside helping to design/deliver scalable data platforms and state-of-the-art AI solutions, you will act as a Team Manager for ~10-20 specialists.

What you’ll do:

• Lead technical design and implementation of data pipelines, warehouses and integration solutions

• End-to-end development of data architectures and ETL processes

• Implementing data governance, data quality, and data security best practices across data systems

• Collaborating with clients and internal teams to translate business needs into robust data solutions

• Acting as both direct and indirect Team Manager for 10-20 specialists, providing them with mentoring and guidance

• Staying up-to-date with the latest developments in data engineering & AI world

• Explore and apply Machine Learning/AI solutions in projects

Tech stack:

During projects you will work with different tools, but the most core tech stack we use is:

Databricks, PySpark, Azure cloud and services (Data Lake, SQL Database, Azure Databricks, Data Factory), SQL, Python, MS Fabric, Azure OpenAI, Azure AI Foundry, Copilot Studio

Required skills:

For this role, you will need hands-on experience with:

• Databricks

• Azure cloud and services (e.g. Data Lake, SQL Database, Azure Databricks)

• Python and PySpark

• SQL

• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance

• AI solutions: Azure OpenAI, Azure AI Foundry

• Docker/Kubernetes

• English (B2)

Nice to have:

• Experience with MS Fabric

• Knowledge of machine learning concepts and frameworks (e.g. MLflow, TensorFlow)

• Knowledge/experience with LLMs and orchestration frameworks

• Familiarity with GitHub Copilot, Copilot Studio, Cursor or similar tools

If you want to ask any questions before applying, feel free to reach out via LinkedIn!