Senior BigData Developer

We run our projects in SCRUM/Agile methodology as we believe that continuous delivery that enables quick feedback loop is the key to our success and satisfaction of our clients. To achieve our goals, we use Scala, Python, Java, SQL/HQL, Airflow, ControlM, Jenkins, Github, Hive, Databricks, Azure, S3, Maven. To ensure the highest quality we use Unit Tests with Quality tests, Automation and Pull Requests review.

WHAT YOU WILL BE DOING

We are looking for a Tech Lead in Data Engineering team with a strong background in Spark/Scala technology to lead the design and delivery of cutting-edge data-driven solutions. This role combines hands-on engineering with technical leadership – you will both architect scalable data systems and guide a team to successful implementation.

As a Technical Leader, your will:

· Lead end-to-end technical delivery of data engineering projects.

· Architect, design, and implement scalable data pipelines and platforms.

· Optimize workflows for data ingestion, processing, and storage (Spark, Airflow, Cloudera, DataBricks, Hive).

· Develop and maintain data lake solutions for structured and unstructured data.

· Collaborate with global teams (business, data, and technology) to align solutions with organizational objectives.

· Oversee code quality, CI/CD pipelines, versioning, and release management.

· Write and review high-quality Scala/Spark code and contribute to automation.

· Mentor and support engineers, fostering technical excellence and growth.

· Ensure delivery is aligned with regulatory and compliance requirements.

· Hands-on experience with testing Big Data solutions - unit tests, integration tests, E2E tests.

· Understanding AI tools and techniques and how they can contribute to increasing development efficiency.

WHAT WE ARE LOOKING FOR

Required qualifications

· 7+ years of experience in Big Data systems and data management.

· 3+ years of hands-on experience with Scala/Spark.

· Hands-on with Big Data technologies like Spark, Cloudera, Data Platform, Airflow, Hive.

· Excellent understanding of dimensional data and data modeling techniques.

· Experience implementing and deploying solutions in cloud environments.

· Ability to work independently and take ownership of project deliverables.

· Fluent in English (at least C1 level).

· Bachelor’s degree in technical or mathematical studies.

· Strong communication skills, at least 2 years leading development teams.

Preferred qualifications

· CI/CD and orchestration tools: GitHub Actions, Airflow, Control-M, Bash scripting..

· Knowledge of Databricks, Kafka, Docker, Kubernetes, OpenShift

· Familiarity with cybersecurity practices, code quality (Sonar), code security (Fortify) and SDLC.

· Experience with microservices architecture, REST APIs, frontend technologies (React, NextJS) and backend technologies (NodeJS).