Hadoop / Big Data Developer

Data

Hadoop / Big Data Developer

Data

Powstania Warszawskiego 15, Kraków

Codeblue

Undetermined
B2B
Mid
Remote
4 994 - 6 104 USD
Net per month - B2B

Tech stack

    Big Data

    advanced

    Python

    regular

    MySQL

    regular

    Jenkins

    regular

    Ansible

    regular

    Java

    regular

    Apache Kafka

    regular

    Hadoop

    regular

    Scala

    junior

Job description

Apart from normal Java level (which is typically just one of the competencies) the engineers should meet the following:
 
  • Very good programmers - languages: Java, Scala and Python. 
  • Specialist skills in “big data” technologies. Spark is key for a good chunk of the positions (RDD / Dataframe / Dataset API, Spark functions, joins, aggregations, basic optimization techniques)
  • Various tech skills on Cloudera stack
  • Good knowledge of Hadoop ecosystem, HDFS, Hive, Avro
  • Specialist skills in data warehousing architectures (ETL, etc.)
  • Specialist skills on one or more data platforms (Oracle, MSSQL or similar)
  • Overall knowledge of distributed systems, data partitioning/replication
  • Development tools: Git, Bash, Unix ecosystem
  • Skills in BI/analytics
  • Knowledge of Jenkins or Ansible would be a bonus
Published: 25.11.2021
Office location
ADVERTISEMENT: Recommended by Just Join IT