Senior AI Operations Engineer

Altimi is a technology acceleration partner with impressive experience spanning over 20 years, specializing in the successful delivery of software development projects for international customers. We are based in Poland. Our main area of operation is the DACH region and Scandinavia, where we are known for providing top-notch software development services.

Our primary focus are managed services for companies seeking to accelerate growth, solve complex tech problems, build MVP/POC and/or modify legacy infrastructures. 

The main area of competence include Product & Application Engineering, DevOps, Cloud Security & Managed Services and AI & Data Enablement.

About Project

We help enterprises scale revenue and profit through secure, compliant generative AI solutions.

This role is a key contributor on a small, high-trust team: you’ll design and operate production-grade Azure platforms, embed security at every step, and leverage AI to accelerate delivery. If you enjoy shipping, automating, and owning outcomes with real customer impact, this is for you.

What you’ll do

Architecture & System Design (Agentic)

· Design multi-agent architectures with robust state management, memory, and routing.

· Choose and implement leading frameworks such as LangGraph/LangChain Agents, Microsoft AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, or Haystack Agents—and justify trade-offs.

· Build modular components (planners, tool registries, policy guards, evaluators) that are reusable across clients and domains.

Tooling & Orchestration

· Integrate enterprise tools and data sources via function/tool calling, webhooks, and event-driven flows (Queues/Service Bus/Functions).

· Implement retrieval-augmented generation (RAG) patterns with vector stores (Azure AI Search, pgvector, MongoDB Atlas, Pinecone, Weaviate, Milvus) and structured knowledge (SQL/Graph).

· Add deterministic fallbacks, circuit breakers, and caching to keep latency and cost predictable.

Reliability, Observability & MLOps

· Define SLIs/SLOs for agent runs; implement tracing, metrics, and logging (e.g., Langfuse + OpenTelemetry) and build dashboards for run-level analytics.

· Create evaluation harnesses (automatic + human-in-the-loop) using tools such as Ragas, DeepEval, promptfoo to measure groundedness, task success, safety, and cost.

· Productionize with CI/CD, environment promotion, feature flags, and canary strategies; optimize cost-per-task and time-to-success.

Safety, Security & Governance

· Enforce content and safety policies (redaction, classification, guardrails) with policy-as-code; implement role/tenant isolation and data minimization.

· Collaborate with security teams to align to ISO 27001/SOC 2/NIST/HIPAA/GDPR contexts; deliver audit-ready evidence for agentic workflows.

· Build privacy-first patterns (no data exfiltration by default, least-privilege tool access, secure prompt/trace storage).

Product & Client Impact

· Work directly with enterprise client teams to translate business processes into agentic designs; present trade-offs and proofs-of-value that lead to production.

· Partner with solution leads to create domain-specific agents (e.g., RFP assist, incident RCA drafting, knowledge ops) and reusable templates.

Requirements

Must-have

· 5–8+ years in software/platform engineering with recent production LLM applications (not just prototypes).

· Hands-on expertise with agentic frameworks (one or more of: LangGraph/LangChain Agents, AutoGen, CrewAI, LlamaIndex Agents, Semantic Kernel, Haystack Agents) and tool/function-calling patterns.

· Strong RAG engineering across vector DBs, chunking/embedding strategies, metadata/search ranking, and grounding techniques.

· Proven track record building observable, cost-aware, and secure LLM systems (tracing, evals, guardrails, secrets/IAM, PII handling).

· Solid software engineering fundamentals: Python/TypeScript, async patterns, APIs, testing, CI/CD, containerization.

· Clear communicator who can interface with clients and write crisp technical docs.

Nice to have

· Azure-first experience (Azure OpenAI, Azure AI Studio, Azure Functions/Container Apps/AKS, Private Link/VNet, Key Vault, Entra ID).

· Cross-cloud exposure (AWS/GCP) and hybrid integrations; experience with enterprise connectors (SharePoint/OneDrive, ServiceNow, Salesforce).

· Experience with structured output, constrained decoding, JSON Schemas, and program-of-thought planning

We Offer

• MultiSport card

• LuxMed medical package

• Allianz group insurance

• Value-based work culture

• Flexible working hours and remote work options