Senior Databricks Engineer

We’re looking for specialists open to cooperate on B2B basis, for our customer – Avanade Poland.

Avanade website; Privacy policy

This role is available for both specialists open to work remotely (within Poland) or in hybrid mode (offices in Wroclaw and Krakow).

Position:

As Senior Databricks Engineer, you will be working in projects for various domains and industries, focused mostly around Databricks and Azure cloud. Among your tasks there will be:

• Designing, building, and maintaining scalable, efficient, and reliable data pipelines

• End-to-end development of data architectures and ETL processes

• Collaborating with data scientists, analysts, and other engineering teams to ensure data integration and optimization

• Implementing best engineering practices across data systems

• Optimizing performance of data workflows and ensuring the reliability of data solutions

• Staying up-to-date with the latest developments in data engineering world

• Acting as a Team Lead in the project if needed

• Possibility to develop yourself in AI engineering
  

Required skills:

For this role, we require commercial experience with:

• Databricks

• Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks)

• Python and PySpark

• SQL

• Data Engineering concepts such as ETL, data modeling, data warehousing, data governance

• Docker and Kubernetes

• English (B2)

Nice to have:

• Knowledge of OCR and corresponding libraries (e.g. easyOCR)

• Any experience in data science area

If you want to ask any questions before applying, feel free to reach out via LinkedIn!