Senior Big Data Engineer
Data
Senior Big Data Engineer
Data
Centrum, Kraków
DCV Technologies
Undetermined
B2B
Senior
Remote
5 539 - 6 369 USD
Net per month - B2BTech stack
Apache Kafka
Hadoop
hBase
RDD
Spark
ActiveMQ
ZeroMQ
Python
Scala
SQL
Job description
Our client, a global leader in next-generation digital services and consulting is currently seeking a number of Senior Big Data Engineer to be based remotely, but within Mainland Poland.
As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.
Responsibilities:
As a Senior Big Data Engineer will be building and implementing enterprise grade software systems. You will design, build, and integrate data from various resources into data marts & warehouses and build large scale data processing pipelines in the context of top data analytics projects.
Responsibilities:
- Designing, developing and maintaining big data software pipelines
- Being involved in team discussions about projects that requires data science and machine learning computation
- Developing complex data workflows based on data integration between Apache Kafka, Hadoop, HBase, Spark and other similar systems
- Solving and enhancing bottlenecks in the software stack by devising scalable distributed solution between different internal data centers and GCP cloud solution
Basic requirements:
- Hands on experience in building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Senior level knowledge of big data tools: Apache Kafka,Hadoop, HBase, etc.
- Experience with Spark - specific focus on optimization, data manipulation (rdd, spark SQL` queries) and persistence (HDFS, parquet, HBase)
- Experience with RabbitMQ, ActiveMQ, and ZeroMQ Message Brokers
- Practical experience programming in Python and Scala
- Strongly self-motivated and self-driven, a good team player
- Excellent verbal and written communication skills in English
Nice to have:
- Ph.D. degree in Computer Science or related technical field
- Familiarity with Agile development methodology preferably Scrum
What we offer:
- Full remote job as well as attractive office location near to Cracow City Center in High5ive office complex
- Cooperation with experienced and open-minded team
- Attractive salary adequate to skills and experience
- Private medical care
- Multisport card
- Friendly atmosphere
Published: 28.06.2021
Office location
ADVERTISEMENT: Recommended by Just Join IT
Check similar offers
ADVERTISEMENT: Recommended by Just Join IT