Senior Big Data Engineer
Data
Senior Big Data Engineer
Kraków
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Tech stack
Big Data
Apache Kafka
Hadoop
Spark
RabbitMQ
ActiveMQ
ZeroMQ
Python
Scala
English
Job description
Online interview
Kloud9 is intentional and ambitious in connecting retail to the Cloud. We have already seen and experienced its many great benefits and Kloud9 is here to exploit its potential to the full. At Kloud9, we cultivate challenge and a constantly evolving environment geared to finding effective solutions for the technologies of tomorrow.
We are building a tactical unit of innovators to bring the cloud revolution to e-commerce. We don’t hire employees, we hire pioneers. Are you ready to be part of the future?
As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.
Responsibilities:
- Designing, developing and maintaining big data software pipelines
- Being involved in team discussions about projects that requires data science and machine learning computation
- Developing complex data workflows based on data integration between Apache Kafka, Hadoop, HBase, Spark and other similar systems
- Solving and enhancing bottlenecks in the software stack by devising scalable distributed solution between different internal data centers and GCP cloud solution
Basic requirements:
- Hands on experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Senior level knowledge of big data tools: Apache Kafka, Hadoop, HBase, etc.
- Experience with Spark - specific focus on optimization, data manipulation (rdd, spark SQL` queries) and persistence (HDFS, parquet, HBase)
- Experience with RabbitMQ, ActiveMQ, and ZeroMQ Message Brokers
- Practical experience programming in Python and Scala
- Strongly self-motivated and self-driven, a good team player
- Excellent verbal and written communication skills in English
Nice to have:
- Ph.D. degree in Computer Science or related technical field
- Familiarity with Agile development methodology preferably Scrum
What we offer:
- Full remote job as well as attractive office location near to Cracow City Center in High5ive office complex
- Cooperation with experienced and open-minded team
- Attractive salary adequate to skills and experience
- Private medical care
- Multisport card
- Friendly atmosphere
Check similar offers
