Data Engineer – Real Time Data
-, Łódź +9 Locations
IMG ARENA
Your responsibilities
Building data processing pipelines both streaming and batch
Feature engineering, combining data sets from internal and external sources
Managing and maintaining standards for Data Analysis tools used across the organisation
Contributing to future design/architecture solutions that directlyimpact the business
Exploring and innovating with sports data to discover new data products.
Our requirements
2 years of experience in data engineering
Programming (e.g. Python, Scala)
Large-scale data manipulation and processing (e.g. SQL, Spark, Pandas, BigQuery)
Analytical mind with problem-solving skills
Approachable and a proficient communicator across both technical and non-technical organisational levels.
Nice to have
Experience with Kubernetes and Docker
Real-time analytics databases (e.g. Apache Druid)
Streaming applications (e.g. Spark Streaming, Kafka Streams)
Data analysis, reporting and visualisation (e.g. Superset, Tableau).
Technologies we use:
- Spark
- Scala
- BigQuery
- Apache Druid
- Kubernetes
- Airflow
- Docker, Terraform.
Our offer:
- B2B contract (optionaly contract of employment)
- Fully remote work
- English lessons
- Referral Scheme
- Extra-ordinary projects
- International work environment
- Integration meeting.