We are seeking a highly skilled Data Engineer to design, develop, and maintain robust ELT/ETL pipelines on cloud infrastructure. The ideal candidate will have a strong foundation in Python and SQL programming, as well as hands-on experience with containerization and orchestration using Docker and Kubernetes.
Engagement Terms:
-
Project Industry: IT Consulting
-
Location: 100% remote
-
Start Date: ASAP (candidates with up to a 3-month notice period are welcome)
-
Rate: Negotiable (165 - 185 PLN net + VAT per hour)
-
Engagement Type: B2B (outsourced through 1dea), full-time, long-term
Recruitment Process (100% remote):
-
Brief introductory call with a 1dea recruiter: (~10 minutes)
-
Technical and project assessment with the Client: (~1-1.5 hours)
-
(If successful) Introductory meeting with the Project Manager at the Client: (~30 minutes)
Scope of duties:
- Develop and optimize ELT/ETL pipelines on cloud platforms.
- Write efficient and maintainable Python and SQL code.
- Collaborate with teams to define data requirements and implement data solutions.
- Implement CI/CD automation for efficient pipeline deployment.
- Ensure data quality, security, and compliance.
- Monitor system performance and troubleshoot issues.
- Stay up-to-date with the latest data engineering technologies and trends
Skills needed:
- 4y+ exp - Proven experience in creating and maintaining ELT/ETL pipelines on cloud infrastructure.
- Proficiency in Python and SQL programming.
- Strong understanding of containerization and orchestration (Docker, Kubernetes).
- Expertise in CI/CD automation.
- Experience with AWS (or Azure) cloud platforms.
- English at B2+ level (international project-structure
Preferred Skills:
- Experience with ElasticSearch.
- Experience with vector databases (e.g., Milvus).
- Understanding of data operations, security, and monitoring.
As our data infrastructure grows, the ability to manage and optimize operations becomes increasingly critical. We are looking for a candidate who can anticipate potential challenges and implement proactive solutions to ensure system reliability and performance.
We offer:
- Long-term B2B contract
-
Join a well-established company: Become part of a firm with a strong market position.
-
State-of-the-art equipment and software: Be equipped with the latest tools and technology.
-
Flexible working hours: Enjoy the freedom to manage your time effectively.
-
100% remote work: Work from anywhere you prefer.
-
Career development: Receive professional guidance and support from our experienced 1dea team.
-
Collaborative culture: We value teamwork, openness, respect, and mutual support in developing skills.
-
Foster creativity: Your ideas and suggestions are welcomed and valued.