Senior Data Engineer (Spark)

What you will be doing

• Own and improve our big data pipelines in AWS Spark. 

• Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.

• Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.

• Work closely with our data scientists and our data engineers to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies. 

Tech stack

• Spark, Python, Scala, SQL, Redshift, Athena, S3, Airflow, EMR

We're looking for: 

• 5+ years of experience with building and optimizing big data pipelines in Apache Spark

• 5+ years of experience with Python and Java

• Advanced with relational SQL databases and SQL

• 3+ years of experience with one of DB: MSSQL, Postgres, AWS Athena (Presto), Redshift

• 3+ years of experience in writing unit tests

• Experience with AWS cloud services like EC2, S3, EMR or equivalent

• Strong analytic skills in working with unstructured datasets.

• Experience in root cause analysis of data when asked to answer specific business questions

• Experience working with cross-functional teams

• Strong communication and collaboration skills

• Bachelor’s degree

• English (B2 or higher) 

It'd be nice to have:

• Experience with Scala

• Experience with data pipeline / workflow tools i.e. Apache Airflow

• Experience in AWS solution architecture 

• Experience in implementing complex clustering and classification models on large datasets to support new product development

Benefits

We believe we are stronger when we not only celebrate our many differences, values, and voices but include them in everyday practice. Having a diverse and inclusive culture is essential, which is why we offer a flexible approach to work-life balance, operating in a remote-hybrid way. We also offer an attractive range of additional benefits, including:

• 95% remotely - the team meets in the Warsaw office for 1 day/month

• Summer party and other social events 

• Comprehensive private health care package for you and your family (dental care included)

• Multisport Card

About Us

Opensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance.  Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.

Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never before been possible.

With offices in London, Boston and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.

NOTE: Opensignal only reviews job applications submitted through our official website: https://www.opensignal.com/about/opensignal-careers or https://opensignal.traffit.com/career/If you have received an offer or communication that seems suspicious or did not go through our website, do not share any personal or financial information.If you are unsure about the legitimacy of a job offer or recruitment message you received, please contact us directly at: careers@opensignal.com.