Big Data Developer

About the TeamJoin the Backend Application Capability Team, where we support key projects and initiatives within GBS (Group Business Support) – IT/Technology. Our team focuses on delivering high-quality platform and software development solutions, enabling scalable and efficient data processing systems that support critical business operations.

Key Responsibilities

• Design and develop Big Data solutions using Scala and Apache Spark

• Contribute to the development and maintenance of data platforms within the Hadoop ecosystem

• Write, optimize, and maintain SQL queries for data processing and analysis

• Develop and maintain automation scripts using Linux Shell Scripting

• Collaborate with cross-functional teams to integrate, deploy, and maintain data solutions

• Work with version control systems and CI/CD tools to support efficient development and deployment processes

• Participate in designing scalable data pipelines and data processing architectures

Required Qualifications

• 3+ years of professional experience with Scala

• Practical experience working with Apache Spark

• Knowledge of Linux Shell Scripting

• Strong knowledge of SQL

• Experience with the Hadoop ecosystem (YARN, Sqoop, Hive, Impala, MapReduce, Oozie, etc.)

• Familiarity with version control and CI/CD tools (e.g., Git, Ansible, Bamboo, Jenkins)

Nice to Have

• Experience with functional programming concepts and principles in Scala

• Experience with streaming technologies such as Flink or Kafka

• Basic understanding of data analysis

• Familiarity with SAFe Agile methodology