Tech Lead with Big Data

Python

Tech Lead with Big Data

Python
-, Warszawa

Link Group

Full-time
Permanent
Senior
Remote
6 335 - 7 437 USD
Gross per month - Permanent

Job description

Tech Lead – Big Data

📍 100% remote | 🕒 Full-time | 🌍 International environment


We are looking for an experienced Tech Lead with a strong background in Data Engineering to guide a technical team in designing and building scalable Big Data solutions. This is a hands-on leadership role that combines technology development, mentoring, and responsibility for production-grade infrastructure in a modern, cloud-based environment.


🔧 Key Responsibilities:

  • Provide technical leadership to a team of Data Engineers in large-scale data processing projects
  • Design and develop robust data pipelines using Python, Spark, Databricks, and Azure Cloud
  • Implement and optimize data workflows with Airflow or similar orchestration tools
  • Collaborate closely with DevOps, product teams, and stakeholders in an Agile environment
  • Contribute to infrastructure automation and CI/CD processes
  • Ensure system stability and observability in production (e.g., through tools like Datadog)
  • Stay up to date with emerging technologies — familiarity with blockchain concepts is a plus


✅ Requirements:

  • 5+ years of experience in data engineering, including technical leadership responsibilities
  • Strong hands-on expertise in Python and Big Data tools (e.g., Spark, Databricks)
  • Experience working with Airflow or equivalent data orchestration frameworks
  • Proficiency in Azure Cloud and containerization using Docker
  • Excellent team collaboration and communication skills
  • Solid command of English (written and spoken) in a professional environment


🌟 Nice to Have:

  • Knowledge of blockchain technologies and related data structures
  • Experience with monitoring and production tooling (e.g., Datadog, CI/CD automation)
  • Familiarity with Agile methodologies and enterprise-scale project environments


Tech stack

    English

    B2

    Python

    advanced

    Big Data

    advanced

    Spark

    regular

    Databricks

    regular

    Airflow

    regular

    Microsoft Azure Cloud

    regular

    Docker

    regular

Office location

Published: 14.05.2025