Mid Data Engineer (Confluent / Spark)
-, Warszawa +4 Locations
Upvanta sp. z o.o.
Job Description:
We are seeking a skilled Data Engineer with a focus on Data Streaming to join our advanced data engineering team. The ideal candidate will have hands-on experience with modern data streaming technologies and strong programming skills.
Responsibilities:
Design, develop, and maintain data streaming pipelines (including CDC and other source extractions).
Implement and optimize solutions using Confluent and Spark Structured Streaming.
Collaborate with cross-functional teams to deliver high-quality data engineering solutions.
Apply data engineering best practices, including versioning, release management, and deployment.
Support Agile development processes and integrate with tools such as GitHub Actions, Terraform, Kubernetes.
Requirements:
Strong proficiency in data streaming technologies (CDC, Confluent, Spark Structured Streaming).
Programming experience in Python, SQL, Bash, Node.js and working knowledge of Linux/Unix Shell.
Hands-on experience with data engineering practices (versioning, release management, deployment).
Familiarity with Agile methodologies and software tools like GitHub Actions, Terraform, Kubernetes.
Mid-level experience in data engineering, with the ability to work independently and in a team environment.
We are looking for candidates available to start immediately