Hadoop Administrator – B2B Hybrid | Warsaw (2-3 Days Onsite)

Dear Consultant,

A multinational financial institution is looking for an experienced Hadoop Administrator to join their team in Warsaw. This B2B hybrid role (2-3 days onsite) offers an opportunity to work with cutting-edge Big Data technologies and ensure the reliability and scalability of critical platforms. Send Cv to marcillina.tietjen@dcvtechnologies.co.uk

Role & Responsibilities:

✅ Big Data Administration & Engineering on open-source platforms such as Hadoop, Kafka, HBase, and Spark.

✅ Troubleshoot and debug complex issues, ensuring platform reliability.

✅ Conduct root cause analysis for major production incidents and document learnings.

✅ Implement high-availability solutions for single points of failure.

✅ Plan and execute capacity expansions and upgrades to prevent scaling issues.

✅ Automate repetitive tasks to improve efficiency and reduce human errors.

✅ Develop automations and reports to minimize manual effort using Shell scripting, Ansible, Python, or other programming languages.

✅ Tune alerting and observability to proactively identify and resolve performance issues.

✅ Collaborate with Level-3 teams on cluster hardening and new use cases.

✅ Develop and maintain standard operating procedures and best practices.

✅ Ensure the Hadoop platform meets performance and service level agreement (SLA) requirements.

✅ Perform security remediation, automation, and self-healing as required.

✅ Leverage DevOps tools and best practices in incident, problem, and change management.

Required Skills & Experience:

✔ Strong expertise in Hadoop Administration with platforms like Kafka, HBase, and Spark.

✔ Proficiency in troubleshooting, debugging, and root cause analysis.

✔ Experience with DevOps tools and disciplines like incident, problem, and change management.

✔ Ability to design and implement high-availability and scalable solutions.

✔ Knowledge of automation techniques, with experience in Shell scripting, Ansible, Python, or other programming languages.

✔ Familiarity with security hardening, observability, and self-healing processes.

📍 Location: Hybrid (Warsaw) – 2/3 days onsite

💼 Contract Type: B2B

🌍 Industry: Financial Services