Senior Data Engineer (Spark)

Job title: Senior Data Engineer (Spark)

Department: Engineering

Reporting to: Engineering Manager

Location: Poland

Purpose of Role

We’re looking for a Senior Data Engineer to join our Market Performance Group in transforming our real-world raw data into valuable and credible industry leading metrics that provide insights to our analysts and our customers.

What you will be doing

1. Own and improve our big data pipelines in AWS Spark.
2. Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.
3. Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.
4. Work closely with our data scientists and our data engineers to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies.

We're looking for:

1. 5+ years of experience with building and optimizing big data pipelines in Apache Spark
2. 5+ years of experience with Python and Java
3. Advanced with relational SQL databases and SQL
4. 3+ years of experience with one of DB: MSSQL, Postgres, AWS Athena (Presto), Redshift
5. 3+ years of experience in writing unit tests
6. Experience with AWS cloud services like EC2, S3, EMR or equivalent
7. Strong analytic skills in working with unstructured datasets.
8. Experience in root cause analysis of data when asked to answer specific business questions
9. Experience working with cross-functional teams
10. Strong communication and collaboration skills
11. Bachelor’s degree
12. English (B2 or higher)

It'd be nice to have:

1. Experience with Scala
2. Experience with data pipeline / workflow tools i.e. Apache Airflow
3. Experience in AWS solution architecture
4. Experience in implementing complex clustering and classification models on large datasets to support new product development

About Us

Opensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance. Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.

Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never before been possible.

With offices in London, Boston and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.

Benefits

We believe we are stronger when we not only celebrate our many differences, values, and voices but include them in everyday practice. Having a diverse and inclusive culture is essential, which is why we offer a flexible approach to work-life balance, operating in a remote-hybrid way.

We also offer an attractive range of additional benefits, including:

1. 95% remotely - the team meets in the Warsaw office for 1 day/month
2. Summer party and other social events
3. Comprehensive private health care package for you and your family (dental care included)
4. Multisport Card

Tech stack

Spark, Python, Scala, SQL, Redshift, Athena, S3, Airflow, EMR