A Black-Box Framework for Evaluating Trust in AI Agents

This article proposes a 5-step framework, based on Conformal Prediction, to evaluate the trustworthiness of AI agents. It offers a mathematical guarantee for a provable reliability score, instead of relying on LLMs as judges.