Data Engineer
Warsaw, Poland
We are looking for a Data Engineer who will be responsible for architecting, implementing, and maintaining our analytics platform that will aggregate television viewing metrics and facilitate realtime analysis of audience engagement and viewing behavior. There will be terabytes of data to work on, so experience in designing scalable big data systems is a huge plus.
Responsibilities:
- Analyze and improve the efficiency, scalability, and stability of data collection, storage, and retrieval processes for our core systems.
- Implement Platforms that enable our clients to take advantage of our data.
- Create and manage Platform specific API’s.
- Create, expand, and manage data processing systems/pipelines as necessary.
- Build robust, high-volume production software.
- Create machine learning algorithms that take advantage of combined viewership and demographics data.
Requirements:
- Excellent knowledge developing and debugging in a variety of languages, particularly Python.
- A minimum of three years of professional experience building high-performance, large-scale server applications and reliable software.
- Solid foundation in computer science, with strong competencies in data structures, algorithms and software design.
- Experience with PostgreSQL or other relational databases.
- Knowledge of Hadoop/HBase or other MapReduce-based architectures.
- A scrappy, entrepreneurial attitude that gets high-quality projects done quickly.
Nice to have:
- Experience with Apache Spark
- Basic understanding of Machine Learning