Data Ops Engineer

Project information:

• Industry: banking

• Location: hybrid model in Gdańsk/Gdynia/Warsaw or Lodz (Office attendance required 2 days/week)

• Rate: up to 110 zł/h netto+ VAT

• Duration: Long-term

  
  

Summary:

This role focuses on data ingestion operations within a cloud environment, specifically utilizing the ARC Ingestion Framework on Hadoop. The main objective is to ensure efficient and effective data processing by preparing and testing configurations, thereby maintaining the integrity of ingested data sources.

Responsibilities:

• Ingest data onto Hadoop using the ARC Ingestion Framework.

• Prepare and test configurations for ingesting data sources.

• Maintain and manage the quality of ingested data on production.

• Work collaboratively within an agile team.

Key Requirements:

• Experience with Unix/Linux.

• Proficiency in SQL.

• Knowledge of git version control.

• Ability to troubleshoot and resolve issues.

• Experience in testing configuration settings.

• Familiarity with scrum methodologies.

Nice to Have:

• Familiarity with Jenkins.

• Basic knowledge of Python.

• Experience with Jira, Confluence, Helix/Remedy.

• Knowledge of Hadoop.

• Familiarity with AWS (Amazon Web Services).

• Understanding of robot framework.