AI Senior DevOps Engineer

This is a remote position.

Virtusa is seeking an AI Senior DevOps Engineer to bridge the gap between AI development and production-grade operations. You will be responsible for building the automated "highways" that allow ML models to flow from training to deployment seamlessly. This role requires a strong DevOps foundation combined with an understanding of the unique challenges of MLOps, such as GPU resource management, model versioning, and performance monitoring.

Key Responsibilities:

• CI/CD & MLOps Pipelines: Build and maintain automated pipelines for ML models using Azure DevOps, GitHub Actions, or Jenkins.

• Workflow Automation: Automate model validation, packaging, and deployment workflows to ensure rapid iteration cycles.

• Infrastructure as Code (IaC): Use Terraform or CloudFormation to provision and manage cloud-native infrastructure, focusing on high-availability and scalability.

• Monitoring & Observability: Set up comprehensive monitoring for infrastructure (CPU/GPU/Memory) and model performance (latency and drift) using Prometheus and Grafana.

• DevSecOps Implementation: Integrate security into the heart of the pipeline, including secret management, IAM role configuration, and vulnerability scanning.

• Collaboration: Work closely with Data Scientists and AI Engineers to enable a self-service platform for model deployment.

Requirements

• 6–8 years of experience in DevOps/SRE roles, with a minimum of 2 years focused on MLOps or supporting AI/ML workloads.

• Deep expertise in Jenkins, GitHub Actions, or GitLab CI/CD.

• Hands-on proficiency with Azure DevOps and Terraform (CloudFormation is a strong plus).

• Advanced knowledge of Docker and Kubernetes for managing distributed AI applications.

• Proven experience setting up Prometheus and Grafana dashboards for technical and model-specific metrics.

• Practical experience managing or connecting to MySQL, PostgreSQL, or MongoDB.

• Familiarity with Ansible, Chef, or Puppet for automated environment setup.

• Hands-on experience with SAST/DAST tools and automated vulnerability scanning within CI/CD pipelines.

• Experience with versioning tools for datasets and models (e.g., DVC or similar pipeline versioning logic).

• Professional English (C1) for seamless interaction with global delivery teams.

Benefits

• Professional training programs 

• Work with a team that’s recognized for its excellence. We’ve been featured in the Deloitte Technology Fast 50 & FT 1000 rankings. We’ve also received the Great Place To Work® certification for five years in a row