Test Engineer – Conversational AI / GenAI (m/k/n)

We are looking for an experienced Test Engineer to join a team delivering projects in the areas of Conversational AI, chatbots, and GenAI solutions. The person in this role will be responsible for designing and executing test strategies for modern AI-based systems.

Responsibilities:

• Designing and implementing test architectures for Conversational AI solutions and MCP / GenAI integrations

• Creating and maintaining automated test cases for conversational interfaces

• Testing AI components (NLP/NLU), performing end-to-end testing, and validating ethical aspects

• Analyzing test results, monitoring quality, and reporting

• Creating test documentation and structured test concepts

• Collaborating with project teams in agile environments

Must-have requirements:

• Extensive experience in testing Conversational AI / chatbots (e.g. Cognigy, AI agents, live agents) – minimum 2 projects within the last 5 years

• Experience in designing and implementing test architectures for MCP and GenAI integrations – minimum 2 project references

• Strong experience in creating automated tests for conversational interfaces – minimum 2 references (including tools used)

• Experience with testing methodologies for AI components, including NLP/NLU validation, end-to-end testing, and ethical aspects – minimum 2 references

Nice-to-have requirements:

• Experience with Cognigy and MCP platforms – minimum 2 references

• Experience with test automation frameworks such as Selenium, Katalon, Robot Framework (certification or participation in at least 3 projects)

• Experience testing solutions with GenAI integration – minimum 2 references or certifications

• Experience working in agile methodologies (Scrum, Kanban) – minimum 3 years

• Strong ability to create structured test concepts and documentation (sample may be requested)

• Strong communication and presentation skills, especially in explaining complex testing topics (evaluated during the interview)

• Experience with monitoring and analytics tools for test evaluation – minimum 2 project references

• German language skills at B1 level