AI / LLM Software Engineer

About the Role

We are looking for an experienced AI / LLM Software Engineer with a strong backend background in Goland to help us build production-ready AI capabilities.

This is not a pure “Prompt Engineer” role. We are looking for someone who understands how to design and build reliable systems around LLMs: RAG pipelines, AI agents, model integrations, observability, cost control, and AI-specific security.

Go will be one of the main implementation languages, but the core focus is on building robust, scalable, and secure AI-powered systems.

Your Responsibilities

• Design and build production-ready AI / LLM-based features and platform components.

• Integrate LLM APIs and AI models such as OpenAI, Anthropic, Gemini, or local models.

• Build and optimize RAG pipelines, including vector databases, embeddings, chunking strategies, and hybrid search.

• Design and implement AI agents and agentic workflows using LLMs, tools, APIs, and internal data sources.

• Develop backend services and APIs, primarily in Go and occasionally in PHP.

• Monitor and optimize LLM costs, token usage, latency, reliability, and output quality.

• Implement safeguards against prompt injection, data leakage, unsafe tool usage, and improper PII handling.

• Design maintainable systems using clean architecture, DDD, and pragmatic engineering principles.

• Evaluate new AI technologies and apply them where they provide real business value.

• Collaborate with product and engineering teams to bring AI concepts from prototype to production.

Your Profile

• Several years of experience in software engineering, ideally with a strong backend focus.

• Practical experience with LLM-based applications, AI workflows, or AI-assisted products.

• Good understanding of RAG concepts: vector databases, embedding models, chunking, retrieval quality, and hybrid search.

• Experience integrating LLM APIs, working with prompts, structured outputs, and tool/function calling.

• Awareness of AI-specific security risks, including prompt injection, PII stripping, data leakage, and unsafe tool execution.

• Strong backend development experience, preferably with Go.

• Solid understanding of software architecture, clean code, and system design.

• Experience with Docker, Git, CI/CD, and production environments.

• Ability to use modern AI development tools such as Cursor, Claude, Gemini, or JetBrains AI effectively.

• Strong ownership, pragmatic mindset, and good communication skills.

• Fluent English, minimum B2.

Nice to Have

• Experience with vector databases such as Qdrant, Pinecone, Weaviate, Milvus, Elasticsearch, or OpenSearch.

• Experience with AI evaluation, retrieval quality testing, or automated testing of non-deterministic systems.

• Experience with event-driven architectures and asynchronous processing.

• Experience with Kubernetes, RabbitMQ, MySQL, or MariaDB.

• Experience with React and TypeScript.

• Knowledge of PHP or legacy system integration.

• Knowledge of German.

Our Tech Stack

• Languages: Go, TypeScript, JavaScript, PHP

• AI / LLM: OpenAI, Anthropic / Claude, Gemini, Cursor, JetBrains AI, RAG, vector databases, embeddings, hybrid search, AI agents

• Databases: MySQL, MariaDB

• Infrastructure: UNIX, Kubernetes, RabbitMQ, Docker

• CI/CD: GitLab CI, CodeMagic

• Testing: Playwright, Python, Dart, Postman

• Tools: Jira, Confluence, Slack, G-Suite, Sentry

Benefits and Perks

• Private healthcare.

• Cafeteria system.

• Training budget: €800 per year.

• Internal trainings, hackathons, integration trips, and team meetings.

• Referral bonus.

• Startup atmosphere.

• Flexible working hours.

• Remote or hybrid work.

• Modern office with chillout zone, standing desks, bicycle parking, cloakroom, and showers.

• Regular office lunches and integration meetings.

• Some international travel included.