Senior Software Test Engineer - AI Agent
What's the role?
We are looking for a highly skilled Senior Test Automation Engineer to ensure the quality, reliability, and safety of next-generation agentic AI systems for the logistics industry.
In this role, you will own test automation, reliability validation, scenario simulation, and AI-specific evaluation pipelines. You will work with complex, non-deterministic systems involving LLMs, agent workflows, and real-world logistics constraints such as routing, time windows, and geospatial data.
This is not a traditional QA role. You are expected to define what to test and how to test it, build intelligent testing systems, and proactively identify risks in AI-driven behavior.
What You’ll Do:
Design and build automated testing frameworks for backend services, APIs, and AI-driven logistics systems
Develop evaluation pipelines for LLM systems (quality, safety, regression detection)
Create scenario simulations covering routing constraints, time windows, capacities, and geospatial edge cases
Define testing strategies for non-deterministic systems using statistical and tolerance-based validation
Validate geospatial data, routing logic, and integrations with HERE and external APIs
Build tools for synthetic data generation and large-scale test scenario creation
Integrate testing and evaluation into CI/CD for continuous validation
Collaborate with engineers and domain experts to identify failure modes and improve system quality
Who are you?
What We’re Looking For:
Experience in test automation/SDET with strong programming skills (Python preferred)
Experience testing logistics, routing, or geospatial systems (required)
Strong understanding of distributed systems, APIs, and data-intensive applications
Experience with AI/ML systems and evaluating non-deterministic outputs (e.g., LLMs)
Solid grasp of data science concepts (metrics, statistical validation, sampling)
Ability to design test strategies independently for complex and ambiguous systems
Experience working with geospatial APIs/data (e.g., HERE, OSM, or similar)
Familiarity with CI/CD, observability, and AI-assisted development tools
What We Offer:
The opportunity to tackle meaningful and challenging problems
A chance to continuously learn and stay on top of the latest technology trends
Work that has real-world impact, shaping the future of mobility and technology
Regular feedback to help you grow and succeed in your role
A collaborative and supportive team environment where your contributions are valued
Competitive salary plus bonus
Flexible working hours and a hybrid working environment
Medical coverage for you and your family
This role is eligible for Creative Tax Incentive scheme in Poland” or KUP (Autorskie Koszty Uzyskania Przychodu)
Option to work on a B2B contract (please note: benefits, bonus and KUP do not apply in this case)
Change is HERE. Apply Now!
#LI-AK8 #LI-HYBRID
Life at HERE in Poland comes with a competitive total rewards package designed to support your health, wellbeing, and performance. This includes a base salary, a Short-Term Incentive (STI) bonus (percentage based on role), a creative tax advantage for eligible positions, private medical care (including dental), life insurance, a meal allowance, vision reimbursement, a remote work allowance (if applicable), access to MyBenefit and Multisport programs, and various wellbeing initiatives. Paid time off, sick leave, and parental leave are provided in accordance with the Polish Labor Code.
As part of HERE Technologies employment process, candidates will be required to successfully complete a pre-employment screening process. This offer and any related claims are subject to the successful completion of a pre-employment screening. This will involve employment, education, and criminal verification if applicable.
HERE is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, age, gender identity, sexual orientation, marital status, parental status, religion, sex, national origin, disability, veteran status, and other legally protected characteristics.
Who are we?
HERE Technologies is a location data and technology platform company. We empower our customers to achieve better outcomes – from helping a city manage its infrastructure or a business optimize its assets to guiding drivers to their destination safely.
At HERE we take it upon ourselves to be the change we wish to see. We create solutions that fuel innovation, provide opportunity and foster inclusion to improve people’s lives. If you are inspired by an open world and driven to create positive change, join us. Learn more about us on our YouTube Channel.
Share on your newsfeed
Connect With Us!
Not ready to apply? Connect with us to receive industry updates and job alerts related to your interests!
Senior Software Test Engineer - AI Agent
Senior Software Test Engineer - AI Agent