Test Automation Engineer (Python / PySpark / Azure)- Hybrid Warsaw (PL/T)

Dear Consultant,

We are seeking a Test Automation Engineer with strong expertise in Python, PySpark, and Azure data environments. You will focus on validating big data pipelines, ETL workflows, and distributed systems within an Agile team. Send Cv to (marcillina.tietjen@dcvtechnologies.co.uk)if you are interested

Location: Warsaw (Hybrid – 3 days onsite)

Key Responsibilities

• Develop and execute automated tests for big data pipelines and distributed systems

• Validate ETL processes, Delta Lake workflows, and data transformations

• Work with Azure-based tools (Databricks, Data Factory, Storage Accounts)

• Build automation within CI/CD (Azure DevOps / Jenkins)

• Collaborate with engineering teams in an Agile/Scrum setup

• Support data quality, governance, lineage, and monitoring frameworks

Must-Have Skills

• Strong expertise in Python, PySpark, SQL

• Hands-on with test automation frameworks

• Experience with Azure Data Services (Databricks, ADF, Storage Accounts)

• Background in testing big data pipelines, ETL workflows, distributed systems

• Strong CI/CD experience (Azure DevOps, Jenkins)

• Understanding of data governance, data quality frameworks

• Problem-solving mindset; Agile/Scrum experience

Nice to Have

• ML model validation / AI pipeline testing

• Knowledge of data lineage and metadata management

Competencies

• Python

• PySpark

• Test Automation