Big Data Developer (Scala/Spark/Hadoop)

Salary: 1000-1350 PLN/day on B2B

Work model: elastic hybrid from Gdynia / Gdańsk / Warszawa (at least 2 days per week from the office)

Why choose this offer?

• You can expect a flexible work organization
• The international work environment will give you the opportunity to interact with the English language on a daily basis
• Scandinavian organizational culture will provide you with work-life balance, you will gain time for additional training (financed by Jit)
• The Jit community will bring you a nice time during regular integration meetings

Project

We are looking for a Big Data Engineer to help build a new global customer account reporting engine, replacing legacy systems and consolidating all account and payment transaction data into Hadoop. The solution will process billions of transactions monthly and serve 10M+ customers. You will be part of the team, following the SAFe Agile framework. Your role will focus on developing high-performing, scalable, and easily maintainable data processing solutions in Scala and Spark while working with multiple upstream and downstream integrations.

Responsibilities you'll have

• Designing and implementing a high-performance, scalable global reporting solution
• Developing distributed and parallelized data pipelines for massive transaction processing
• Working with Scala and Spark to optimize and transform financial datasets
• Integrating multiple data sources using Hadoop, Kafka, Hive, and Oozie
• Collaborating in an Agile SAFe team with Solution Architects, Analysts, and Developers

Expected competences and knowledge

• 3+ years of experience in functional programming with Scala
• Experience developing Spark-based applications in Scala
• Hands-on experience with Hadoop stack (Hive, Oozie, Kafka)
• Familiarity with containerized technologies (Docker, Kubernetes)
• Strong communication skills and ability to work in distributed teams
• Fluent English (B2 minimum)

Nice to have (not mandatory, but a plus)

• Deep understanding of distributed systems principles
• Experience in data engineering and ETL/ELT pipelines
• Performance tuning experience for Hadoop/Spark solutions
• Experience developing RESTful services
• Knowledge of Bootstrap and ReactJS
• Experience with container-based technologies: Docker, Kubernetes
• Experience working in Agile methodologies

Technologies you'll work with

• Scala
• Spark
• Hadoop (Hive, Oozie, Kafka)
• Docker & Kubernetes
• Jenkins
• JIRA, Bitbucket, Git
• ETL/ELT Pipelines
• Performance tuning for Hadoop/Spark
• RESTful services
• Bootstrap & ReactJS

Client – why choose this particular client from the Jit portfolio?

Jit Team has had an over-decade-long relationship with the leading financial group in the Nordic countries, and we are privileged to be our client's premier partner in Poland. At present, over 200 Jit personnel are engaged in the completion of more than 60 projects for this Norwegian major provider of financial services with a global presence and a strong focus on modern technology. Our customer's work atmosphere is epitomized by the Scandinavian culture, which is conducive to people who place emphasis on work-life balance and feedback culture. Furthermore, all projects are executed in international teams, giving constant exposure to the English language. 

About Jit Team

The Human factor of IT - it's not just a slogan, it's a philosophy. The foundation of Jit Team is people, which is why we prioritise you. We employ over 700 experienced experts. We create highly specialised teams for clients from all over the world. We offer team members developmental projects, a wide range of benefits and a proprietary professional development programme.

Behind our maxim are also charitable and educational activities. We support pupils and students by donating learning equipment. We offer internships to help launch careers in IT. We support water rescuers and hospitals by providing the necessary equipment. We are a Polish company and we share what we have achieved over 15 years of activity. By supporting indigenous initiatives, we ensure the circulation of good energy.