#1 Job Board for tech industry in Europe

  • Job offers
  • All offersKrakówDataSenior Data Engineer (ETL + Python + AWS)
    Senior Data Engineer (ETL + Python + AWS)
    Data
    1dea

    Senior Data Engineer (ETL + Python + AWS)

    1dea
    Kraków
    Type of work
    Full-time
    Experience
    Senior
    Employment Type
    B2B
    Operating mode
    Remote

    Tech stack

      ETL

      advanced

      Python

      advanced

      SQL

      advanced

      Amazon AWS

      regular

      Kubernetes

      regular

      CI/CD

      regular

      English

      regular

      Milvus

      nice to have

    Job description

    Online interview

    We are seeking a highly skilled Data Engineer to design, develop, and maintain robust ELT/ETL pipelines on cloud infrastructure. The ideal candidate will have a strong foundation in Python and SQL programming, as well as hands-on experience with containerization and orchestration using Docker and Kubernetes.

     

    Engagement Terms:

    

    • Project Industry: IT Consulting
    • Location: 100% remote
    • Start Date: ASAP (candidates with up to a 3-month notice period are welcome)
    • Rate: Negotiable (165 - 185 PLN net + VAT per hour)
    • Engagement Type: B2B (outsourced through 1dea), full-time, long-term


    Recruitment Process (100% remote):


    • Brief introductory call with a 1dea recruiter: (~10 minutes)
    • Technical and project assessment with the Client: (~1-1.5 hours)
    • (If successful) Introductory meeting with the Project Manager at the Client: (~30 minutes)


    Scope of duties:

    • Develop and optimize ELT/ETL pipelines on cloud platforms.
    • Write efficient and maintainable Python and SQL code.
    • Collaborate with teams to define data requirements and implement data solutions.
    • Implement CI/CD automation for efficient pipeline deployment.
    • Ensure data quality, security, and compliance.
    • Monitor system performance and troubleshoot issues.
    • Stay up-to-date with the latest data engineering technologies and trends


    Skills needed:

    • 4y+ exp - Proven experience in creating and maintaining ELT/ETL pipelines on cloud infrastructure.
    • Proficiency in Python and SQL programming.
    • Strong understanding of containerization and orchestration (Docker, Kubernetes).
    • Expertise in CI/CD automation.
    • Experience with AWS (or Azure) cloud platforms.
    • English at B2+ level (international project-structure


    Preferred Skills:

    • Experience with ElasticSearch.
    • Experience with vector databases (e.g., Milvus).
    • Understanding of data operations, security, and monitoring.

    As our data infrastructure grows, the ability to manage and optimize operations becomes increasingly critical. We are looking for a candidate who can anticipate potential challenges and implement proactive solutions to ensure system reliability and performance.


    We offer:

    • Long-term B2B contract
    • Join a well-established company: Become part of a firm with a strong market position.
    • State-of-the-art equipment and software: Be equipped with the latest tools and technology.
    • Flexible working hours: Enjoy the freedom to manage your time effectively.
    • 100% remote work: Work from anywhere you prefer.
    • Career development: Receive professional guidance and support from our experienced 1dea team.
    • Collaborative culture: We value teamwork, openness, respect, and mutual support in developing skills.
    • Foster creativity: Your ideas and suggestions are welcomed and valued.