Middle Data Engineer

Join a globally recognized company where innovation meets impact. Our team of seasoned professionals and our commitment to excellence enable us to deliver top-tier solutions that shape industries and drive meaningful results. Be part of a Сompetence Сenter where your expertise will be valued, your voice will be heard, and your career will be empowered.

Customer

It is an international technology company that specializes in developing high-load platforms for data processing and analytics. Its core product helps businesses manage large volumes of data, build models, and gain actionable insights. Operating globally, the company primarily serves clients in the marketing and advertising sectors, and focuses on modern technologies, microservices architecture, and cloud-based solutions.

Responsibilities

• Design, develop, and maintain end-to-end big data pipelines that are optimized, scalable, and capable of processing large volumes of data in real-time and in batch mode

• Follow and promote best practices and design principles for Data Lakehouse architecture

• Support technological decision-making for the business’s future data management and analysis needs by doing POCs

• Write and automate data pipelines

• Assist in improving data organization and accuracy

• Collaborate and work with data analysts, scientists, and engineers to ensure the use of best practices in terms of data processing and storage technologies

• Explore and stay up to date on emerging technologies and proactively shares learnings with the team

• Ensure that all deliverables adhere to our world-class standards

Requirements

• 3+ years of experience in big data development and database design

• Strong hands-on experience with SQL and experience working on advanced SQL

• Proficient in Python and other scripting languages

• Working knowledge of at least one of the big data technologies

• Experience developing software solutions using Hadoop Technologies such as MapReduce, Hive, Spark, Yarn/Mesos, etc.

• At least an Upper-Intermediate level of English

Would be a plus

• Experience with AWS cloud, S3, and Redshift

• Experience with Python

• Knowledge and exposure to BI applications, e.g. Tableau, QlikView

Personal profile

• Excellent analytical and problem-solving skills