Hadoop Administrator

Dear Consultant.

We are seeking a highly skilled Hadoop Administrator to join our client team on a B2B contract basis. This is an exciting opportunity to work with a multinational client head quatered in the US and a leaderin the financial sector, performing Big Data Administration and Engineering tasks on cutting-edge open-source platforms.

Job Opportunity: Hadoop Administrator (B2B Contract)

Location: Warsaw, Poland (Hybrid Work: 2-3 Days Onsite)

Client: Multinational Company in the Financial Sector

Key Responsibilities:

• Administer and engineer Big Data platforms such as Hadoop, Kafka, HBase, and Spark.
• Perform root cause analysis of major production incidents and create learning documentation.
• Design and implement high-availability solutions to address single points of failure.
• Plan and execute capacity expansions and upgrades to prevent scaling issues and bugs.
• Automate repetitive tasks to minimize manual effort and reduce human errors.
• Optimize alerting and observability to proactively identify and resolve issues.
• Collaborate with Level-3 teams to review use cases and implement cluster hardening techniques.
• Develop standard operating procedures and guidelines for platform management and utilization.
• Leverage DevOps tools and practices (Incident, Problem, and Change Management) in day-to-day operations.
• Ensure platform performance meets service level agreement (SLA) requirements.
• Perform security remediation, automation, and self-healing as needed.
• Develop automation scripts and reports using tools like Shell scripting, Ansible, Python, or other programming languages.

Required Skills and Qualifications:

• Strong troubleshooting and debugging skills.
• Experience with open-source Big Data technologies, including Hadoop, Kafka, HBase, and Spark.
• Expertise in high-availability solutions and capacity planning.
• Hands-on experience with automation tools (e.g., Shell scripting, Ansible, Python).
• Familiarity with observability and alerting tools.
• Knowledge of cluster hardening techniques and performance tuning.
• Proficiency in DevOps tools and practices.
• Ability to create and maintain technical documentation.

Work Model:

• Hybrid work setup: 2-3 days per week onsite at the client’s office in Warsaw.

If you’re passionate about Big Data and thrive in dynamic, fast-paced environments, we’d love to hear from you!