Do Verifier Judgments Survive Abstraction? Measuring Verification Transport for LLM Agent Evaluation
Researchers propose Verification Transport, a reliability test that measures whether LLM-based verifier judgments remain stable when agent execution trajectories are exposed through abstractions such as composed tools, delegation boundaries, or compacted histories. Across four agent-evaluation benchmarks, seven verifier backbones, four verification protocols, and three abstraction boundaries, they find substantial transport failure, reaching about 31% under macro abstraction and delegation. Evidence-grounded and deliberative protocols tend to abstain under limited observability, while restoring execution provenance recovers 85.5% of transport failures. The results indicate that native-view accuracy alone is insufficient to characterize verifier reliability in deployed agent systems.
This helps readers understand hidden reliability risks when LLM verifiers judge agent executions across abstraction layers rather than raw trajectories.
Comments & Questions (0)
No comments yet
Be the first to comment!