Senior Big Data Engineer
Data
Senior Big Data Engineer
Kraków
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Tech stack
Apache Kafka
Hadoop
hBase
RDD
Spark
ActiveMQ
ZeroMQ
Python
Scala
SQL
Job description
Our client, a global leader in next-generation digital services and consulting is currently seeking a number of Senior Big Data Engineer to be based remotely, but within Mainland Poland.
As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.
Responsibilities:
As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.
Responsibilities:
- Designing, developing and maintaining big data software pipelines
- Being involved in team discussions about projects that requires data science and machine learning computation
- Developing complex data workflows based on data integration between Apache Kafka, Hadoop, HBase, Spark and other similar systems
- Solving and enhancing bottlenecks in the software stack by devising scalable distributed solution between different internal data centers and GCP cloud solution
Basic requirements:
- Hands on experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Senior level knowledge of big data tools: Apache Kafka,Hadoop, HBase, etc.
- Experience with Spark - specific focus on optimization, data manipulation (rdd, spark SQL` queries) and persistence (HDFS, parquet, HBase)
- Experience with RabbitMQ, ActiveMQ, and ZeroMQ Message Brokers
- Practical experience programming in Python and Scala
- Strongly self-motivated and self-driven, a good team player
- Excellent verbal and written communication skills in English
Nice to have:
- Ph.D. degree in Computer Science or related technical field
- Familiarity with Agile development methodology preferably Scrum
What we offer:
- Full remote job as well as attractive office location near to Cracow City Center in High5ive office complex
- Cooperation with experienced and open-minded team
- Attractive salary adequate to skills and experience
- Private medical care
- Multisport card
- Friendly atmosphere
Check similar offers
