Data Engineer
Data
Data Engineer
Warszawa
Type of work
Undetermined
Experience
Senior
Employment Type
B2B
Operating mode
Remote
Tech stack
Spark
Spark Streaming
Azure
Job description
Online interview
About the project:
- Building data platform for Video-Streaming client
- You will be delivering data in near real-time
- The project is greenfield, it will be Azure, Databricks and many products (ML models, dashboards) based on Data delivered using mostly Spark Streaming
- On top of building Spark Pipelines it will involve DataOps activities:
- Making sure the entire solution is robust (making architecture decisions and executing them)
- Finding right balance between latency and stability
- Tooling around delivering ML models to prod
We are offering:
- Opportunity to learn from seasoned developers with experience working for top global companies
- Flexible hours and a flexible work environment
- Attractive salary (180-220 PLN/h B2B)
You must:
- Have a solid understanding of distributed systems (Spark is a must)
- Have a solid understanding of object-oriented and functional programming
- Have solid knowledge of algorithms and data structures
- Be able to communicate fluently in English
- Be a quick learner and problem-solver
Nice if you:
- Have experience in Streaming
- Have experience with Azure
Check similar offers
