How do you test AI agents in production? The unpredictability is overwhelming.[D]

A QA professional highlights the overwhelming challenges of testing non-deterministic LLM-based AI agents in production, where traditional quality assurance methods fail. They struggle with the variability of outputs and reasoning chains, finding existing approaches like snapshot testing and human evaluation insufficient or unscalable.