Data Engineer
Data
Data Engineer
Data
Malczewskiego, Warszawa
TantusData
Undetermined
B2B
Senior
Remote
7 514 - 9 228 USD
Net per month - B2BTech stack
Spark
Spark Streaming
Azure
Job description
About the project:
- Building data platform for Video-Streaming client
- You will be delivering data in near real-time
- The project is greenfield, it will be Azure, Databricks and many products (ML models, dashboards) based on Data delivered using mostly Spark Streaming
- On top of building Spark Pipelines it will involve DataOps activities:
- Making sure the entire solution is robust (making architecture decisions and executing them)
- Finding right balance between latency and stability
- Tooling around delivering ML models to prod
We are offering:
- Opportunity to learn from seasoned developers with experience working for top global companies
- Flexible hours and a flexible work environment
- Attractive salary (180-220 PLN/h B2B)
You must:
- Have a solid understanding of distributed systems (Spark is a must)
- Have a solid understanding of object-oriented and functional programming
- Have solid knowledge of algorithms and data structures
- Be able to communicate fluently in English
- Be a quick learner and problem-solver
Nice if you:
- Have experience in Streaming
- Have experience with Azure
Tech stack
Spark
Spark Streaming
Azure
Office location
Published: 17.03.2021
ADVERTISEMENT: Recommended by Just Join IT
Check similar offers
Check similar offers
ADVERTISEMENT: Recommended by Just Join IT