Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation
Researchers propose Verification Transport, a reliability test that measures whether LLM-based verifier judgments remain stable when agent execution trajectories are exposed through abstractions such as composed tools, delegation boundaries, or compacted histories. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, they find substantial transport failure, reaching about 31% under macro abstraction and delegation. Evidence-grounded and deliberative protocols tend to abstain under limited observability, while restoring execution provenance recovers 85.5% of transport failures. The results indicate that native-view accuracy alone is insufficient to characterize verifier reliability in deployed agent systems.
Why it matters: This helps readers understand hidden reliability risks when LLM verifiers judge agent executions across abstraction layers rather than raw trajectories.