AI UX Researcher

We are hiring a Senior AI UX Researcher to lead research across AI-driven products within our venture portfolio.

This role goes beyond traditional usability testing. You will evaluate intelligent systems powered by models such as Claude and other leading large language models, studying both:

• Model behavior

• Human interpretation and trust

You will define research standards, shape AI evaluation frameworks, and directly influence how our AI systems behave in real-world conditions.

This is a senior-level role requiring independent ownership, strategic thinking, and cross-functional leadership.

Key Responsibilities

AI Model Evaluation & Quality Frameworks

• Design structured evaluation systems for AI outputs

• Identify hallucinations, reasoning gaps, bias risks, and edge-case failures

• Compare performance across models (Claude and others)

• Define internal quality benchmarks for AI-driven features

Human-AI Interaction Research

• Lead research on conversational and agentic interfaces

• Study user trust formation, breakdown points, and decision confidence

• Evaluate explainability mechanisms and AI feedback patterns

• Identify friction in real user workflows

Explainability, Transparency & Trust

• Research how explanations influence user behavior

• Define best practices for uncertainty communication

• Validate fallback strategies and error recovery experiences

• Support AI safety and compliance awareness in product design

Research Strategy & Cross-Functional Leadership

• Partner closely with product, AI engineering, and design leadership

• Influence roadmap decisions with structured evidence

• Establish repeatable research playbooks for AI iteration cycles

• Mentor other researchers where relevant

Measurement, Experimentation & Continuous Improvement

• Define qualitative and quantitative AI experience metrics aligned with product objectives (e.g. task success, trust, retention, conversion)

• Design and run structured experiments (A/B tests, prompt variations, explanation variants, model comparisons)

• Use research and experimentation tools to validate hypotheses and inform roadmap decisions

• Create evaluation dashboards and scoring frameworks tied to business outcomes

• Support launch readiness with structured AI validation and post-launch performance tracking

Required Experience

• 5+ years in UX research, with meaningful exposure to AI systems or conversational products

• Demonstrated experience leading complex research initiatives independently

• Hands-on experience using Claude and at least one other major AI model in structured evaluations

• Strong understanding of LLM behavior, including hallucination patterns, uncertainty, bias, and calibration

• Experience translating research insights into product and engineering decisions

Strongly Preferred

• Experience building AI evaluation frameworks from scratch

• Exposure to AI safety or compliance considerations

• Familiarity with prompt design and multi-model systems

• Comfort working with logs, structured datasets, or AI testing environments