Big Data Engineer
Data
Big Data Engineer
Szczecin
Type of work
Undetermined
Experience
Mid
Employment Type
B2B
Operating mode
Remote
Tech stack
Cassandra
English
Python
Big Data
Data
Pandas
Airflow
Job description
Online interview
PlumResearch - Get to know us!
We’re an independent company dedicated to providing the most reliable insights into the global entertainment industry. Since 2015, we’ve been partnering with the world’s largest media & entertainment companies, talent agencies, and broadcasters who rely on our unbiased data to enhance business decisions.
We are the global leader in device-agnostic Netflix audience measurement, and have panels in 15 countries, reaching hundreds of thousands of active users. Our company and products have received numerous awards, including the Best of Show Content Measurement Innovation Award at the 2019 National Association of Broadcasters Show in Las Vegas. Our teams are located in Szczecin, Wroclaw, Warsaw and New York
Role description
We’re an independent company dedicated to providing the most reliable insights into the global entertainment industry. Since 2015, we’ve been partnering with the world’s largest media & entertainment companies, talent agencies, and broadcasters who rely on our unbiased data to enhance business decisions.
We are the global leader in device-agnostic Netflix audience measurement, and have panels in 15 countries, reaching hundreds of thousands of active users. Our company and products have received numerous awards, including the Best of Show Content Measurement Innovation Award at the 2019 National Association of Broadcasters Show in Las Vegas. Our teams are located in Szczecin, Wroclaw, Warsaw and New York
Role description
As an engineer you will support and develop the existing system gathering and processing Big Data. You’ll be joining a growing team that is excited about technology, scalability and eager to share extensive knowledge with you. We’re particularly interested in engineers who have a talent for developing unconventional, fully-operational solutions. A successful candidate should have strong analytical and programming skills alongside the ability to diagnose and solve functional and performance problems.
On a day-to-day basis you will:
- maintain and improve existing pipelines, add new data processing pipelines in Airflow
- optimize pipelines for handling large amounts of data
- actively participate in choosing methods for solving any technological problems
The ideal candidate:
- is proficient in Python 3 (with basics of Pandas)
- is proficient in Cassandra
- has knowledge of large data set processing (at least GBs+ of data / tens millions rows)
- has 2+ years of experience in a similar role
- easily communicates in English (at least B2 level)
We’d also love to see, but don't require experience with:
- Airflow
- Ability to write modular and testable code / Experience with Unit tests and Linux
- Designing and building data pipelines using any of (but not limited to) the following: ClickHouse, Kafka, Spark, NoSQL, Hadoop/HDFS/Hive, Flink, Druid or their cloud alternatives
What we offer:
- A unique opportunity to enter a booming industry and to influence the future of audience measurement.
- A chance to work in an international environment with exceptional experts.
- Internal Workshops: access to unique knowledge within the organization and a network of outstanding experts and business partners from around the world
- Competence Day: every 2 weeks, you can spend all day on your professional development. You choose the subject and scope yourself, so you can learn a new technology, take an online course, or carry out a micro-project together with others if you think it’ll improve your skills.
- Access to private health care, Multisport membership card and life insurance.
- Possibility to work either in the office or remotely.
- A competitive salary, with an established growth track - apply to learn more!
Rhythm of work:
Tech stack (processing): Python (Pandas, Django), Docker, Airflow, Cassandra, MySQL/PostreSQL, RabbitMQ, NodeJS (Typescript), Kubernetes, Docker, Gitlab CI, Linux
Organization: Jira, Scrum, in Polish and English
Daily meetings: 10:30
Location: currently offering remote work (until further notice). The target model is a hybrid of remote and office work. The IT office is located in Szczecin at al. Piastów 22.
Current team size: 17
Working hours: 8-hour working day. We start between 7:00am to 10:00am and work until 3:00pm to 6:00pm.
Join us and power entertainment with data!
Check similar offers
