Senior Automation QA Engineer with AI

Svitla Systems Inc. is looking for a Senior Automation QA Engineer with AI for a full-time position (40 hours per week) in Kraków, Poland. Our client is is a British wholesale distributor. 

This role is for a Quality Assurance Engineer who is excited about testing AI-powered systems, working with non-deterministic outputs, and helping ensure reliability, correctness, and trust in a production-grade platform. You will be part of a newly formed engineering team and will have significant influence over testing strategy, quality standards, and tooling. We are looking for someone who can define and build the QA strategy from the ground up, including test frameworks, quality standards, and processes for validating both deterministic and AI-powered system behaviors.

Office work is expected 2-3 days per week. 

Requirements:

• Strong experience in Java / Node.js (or TypeScript) for building and maintaining test automation frameworks and backend testing utilities.

• Ability to work effectively in environments with a high degree of uncertainty, taking a pragmatic, solution-oriented approach to problem-solving.

• Strong understanding of test design principles, with hands-on experience in automating tests for APIs, backend services, and front-end applications.

• Experience working with LLMs and AI tools to improve development and testing efficiency (e.g., code generation, test automation, debugging).

Responsibilities:

• Develop and continuously enhance robust, scalable test automation frameworks using Java / Node.js (Playwright / REST Assured).

• Drive quality initiatives and testing strategies in collaboration with cross-functional teams, including development and product.

• Designing validation approaches for AI-driven and non-deterministic components, including defining test datasets, evaluation criteria, and acceptable quality thresholds.

• Own the execution and management of both manual and automated test cases.

• Investigate and troubleshoot issues using HTTP protocols and browser DevTools, ensuring precision in defect isolation and resolution.

• Take ownership of the testing lifecycle, proactively identifying opportunities to improve test coverage, reliability, and overall system quality.

• Continuously improve QA processes, tooling, and metrics to support scalable, production-grade AI systems.

We offer

• US and EU projects based on advanced technologies.

• Competitive compensation based on skills and experience.

• Regular performance appraisals to support your growth.

• Flexibility in workspace, either remote or our welcoming office.

• Bonuses for article writing, public talks, other activities

• Generous time off, including vacation, national holidays, sick leaves, and family days.

• Personalized learning programs tailored to your interests and skill development.

• Free tech webinars and meetups organized by Svitla.

• Regular corporate online activities.

• Awesome team and a friendly, supportive community!