Link Group
Hundreds of IT opportunities are waiting for you—let’s make it happen! Since 2016, our team of tech enthusiasts has been building exceptional IT teams for Fortune 500 companies and startups worldwide. Join impactful projects in BFSI, CPG, Industrial, and Life Sciences & Healthcare industries. Work with cutting-edge technologies like Cloud, Business Intelligence, Data, and SAP. Unlock your potential, grow your skills, and collaborate with top global clients. Ready for your next big career move? Let’s link with us!
Tech stack
Python
PySpark
Docker
Kubernetes
CI/CD
AWS
GCP
Azure
Apache Airflow
Kafka
Job description
What You’ll Do:
- Develop high-quality, production-ready Python code with a focus on PySpark for big data processing.
- Build and maintain scalable data pipelines, automating workflows for efficiency and reliability.
- Leverage Docker & Kubernetes to containerize and orchestrate applications in a cloud environment.
- Ensure best coding practices, implementing automated testing to maintain robust and error-free deployments.
- Collaborate with cross-functional teams to optimize data processing and integration.
What You Bring:
✅ Strong experience with Python & PySpark in a production environment.
✅ Hands-on expertise in containerization (Docker, Kubernetes).
✅ Solid understanding of big data processing and how to handle large datasets efficiently.
✅ Experience in automation—from CI/CD pipelines to test automation.
✅ Knowledge of coding best practices, ensuring clean, maintainable, and scalable code.
Nice to Have:
- Experience with cloud platforms (AWS, GCP, Azure).
- Exposure to orchestration tools like Apache Airflow.
- Familiarity with streaming data technologies (Kafka, Spark Streaming).
Net/month - B2B
Check similar offers
