The Benchmark Is Not the Behavior

A UC Berkeley team demonstrated how to exploit flaws in eight AI agent benchmarks by manipulating evaluation methods. This raises serious questions about the integrity of AI evaluation, as benchmarks rely on a vulnerable "honor system."