Big Data Engineer with Spark and Scala
We are looking for an experienced Big Data Engineer to join our data engineering team responsible for creating and evolving a next-generation data platform. This platform plays a key role in supporting a variety of business functions and engaging with multiple stakeholders across the organization.
Your tasks
Design, develop, and maintain scalable data pipelines and processing systems
Build efficient solutions for collecting, transforming, and integrating data from diverse sources
Translate business and analytical needs into technical requirements and data models
Optimize data workflows to ensure high performance, reliability, and resilience
Develop and maintain Spark/Scala-based jobs for data ingestion and transformation
Participate in code reviews and contribute to continuous improvement initiatives
Work collaboratively within an Agile (Scrum) environment, delivering business value in short iterations
Follow best engineering practices such as TDD, BDD, clean coding, and DevOps principles
Create and maintain technical documentation and test plans
Requirements
Min. 5 years of professional experience in Big Data engineering, preferably in the banking or financial services sector
Proficiency in Spark, Scala, and SQL
Working knowledge of additional tools and technologies such as Python, Java, Airflow, DevOps, CI/CD pipelines, APIs, microservices, and Git
Excellent analytical and troubleshooting skills
Strong communication and teamwork abilities
Proactive, self-driven approach to work
Ability to collaborate effectively with international teams across different time zones
Solid organizational and prioritization skills
Fluency in English, both spoken and written
Open to a hybrid work model (2-3 days per week on-site)
Sii Polska to czołowy dostawca doradztwa technologicznego, transformacji cyfrowej oraz usług biznesowych i inżynieryjnych. Firma obecna jest na rynku od 2006 roku, zatrudnia ponad 7 300 ekspertów, jedenastokrotnie zdobył...
Big Data Engineer with Spark and Scala
Big Data Engineer with Spark and Scala
-, Warszawa
Sii