Lead Data Engineer
Job description
Responsibilities
Lead the design and development of scalable data platforms on GCP.
Build and optimize batch and streaming data pipelines.
Define data architecture, standards, and engineering best practices.
Mentor data engineers and provide technical leadership.
Collaborate with business and technical stakeholders.
Drive Agile delivery and continuous improvement initiatives.
Requirements
8+ years of Data Engineering experience.
Strong expertise in GCP, PySpark, Apache Spark, Scala or Python, SQL, Airflow
Hands-on experience with Hadoop and Hive.
Knowledge of cloud architecture and design patterns.
Experience with Linux, Git, Jenkins, Ansible, and JIRA.
Strong debugging and performance tuning skills.
Openness to AI-driven technologies and solutions.
Tech stack
GCP
PySpark
Apache Spark
Python
SQL
Airflow
Office location
About the company
Link Group
Hundreds of IT opportunities are waiting for you-let’s make it happen! Since 2016, our team of tech enthusiasts has been building exceptional IT teams for Fortune 500 companies and startups worldwide. Join impactful proj...NEXA SPÓŁKA Z OGRANICZONĄ ODPOWIEDZIALNOŚCIĄ
Remote
Remote