Data Engineer/Data Analyst with Quantexa

Information about the project:

• Industry: banking

• Rate: up to 210 PLN/H net + VAT, B2B

• Location: remote (Poland/Warsaw)

• Long-term cooperation

Summary:

We are seeking a driven Data Engineer/Data Analyst with a solid understanding of the end-to-end ETL pipeline and a foundational knowledge of data engineering principles. The ideal candidate will possess proficiency in Hive SQL (SPARK) and SCALA, alongside relevant skills in shell scripting. This role presents a unique opportunity to work within a dynamic environment, contributing to innovative data solutions.

Main Responsibilities

• Develop and optimize Hive SQL (SPARK) queries to support data processing tasks.

• Utilize SCALA to enhance data engineering processes.

• Implement shell scripting for automation purposes.

• Work with Cloudera distribution tools, including Oozie, for workflow management.

• Collaborate with team members to integrate Elasticsearch solutions.

• Support projects involving Quantexa technology.

Key Requirements

• Proficiency in Hive SQL (SPARK).

• Strong knowledge of SCALA.

• Experience with shell scripting.

• Familiarity with Cloudera distribution (Oozie).

• Basic knowledge of Elasticsearch.

• Understanding of Quantexa platform.

Nice to Have

• Familiarity with IntelliJ.

• Experience using Zeppelin.

• Knowledge of Bamboo, Jenkins, Nexus, and Artifactory.

• Basic understanding of Kafka.