#1 Job Board for tech industry in Europe

Senior Big Data Engineer
Data

Senior Big Data Engineer

Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote

Tech stack

    Apache Kafka

    advanced

    Hadoop

    advanced

    hBase

    advanced

    RDD

    regular

    Spark

    regular

    ActiveMQ

    regular

    ZeroMQ

    regular

    Python

    regular

    Scala

    regular

    SQL

    nice to have

Job description

Our client, a global leader in next-generation digital services and consulting is currently seeking a number of Senior Big Data Engineer to be based remotely, but within Mainland Poland.

As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.

Responsibilities:

  • Designing, developing and maintaining big data software pipelines 
  • Being involved in team discussions about projects that requires data science and machine learning computation 
  • Developing complex data workflows based on data integration between Apache Kafka, Hadoop, HBase, Spark and other similar systems 
  • Solving and enhancing bottlenecks in the software stack by devising scalable distributed solution between different internal data  centers and GCP cloud solution

Basic requirements:
 
  • Hands on experience in building and optimizing ‘big data’ data pipelines, architectures and data sets. 
  • Senior level knowledge of big data tools: Apache Kafka,Hadoop, HBase, etc. 
  • Experience with Spark - specific focus on optimization, data manipulation (rdd, spark SQL` queries) and persistence (HDFS, parquet, HBase) 
  • Experience with RabbitMQ, ActiveMQ, and ZeroMQ Message Brokers 
  • Practical experience programming in Python and Scala 
  • Strongly self-motivated and self-driven, a good team player 
  • Excellent verbal and written communication skills in English

Nice to have:
 
  • Ph.D. degree in Computer Science or related technical field 
  • Familiarity with Agile development methodology preferably Scrum

What we offer: 

  • Full remote job as well as attractive office location near to Cracow City Center in High5ive office complex 
  • Cooperation with experienced and open-minded team
  • Attractive salary adequate to skills and experience 
  • Private medical care
  • Multisport card
  • Friendly atmosphere