arXiv:2611.06662v1 Announce Type: new
Abstract: Search-augmented reasoning systems can reach correct answers while making errors in intermediate steps. Reliable auditing must check whether evidence $D$ covers the question $Q$, reasoning $T$ addresses $Q$, and $T$ is grounded in $D$. We introduce GraphRail, which represents requirements, evidence, and reasoning as structured claims and compares them without a generative judge or gold answer. Across three multi-hop QA benchmarks and three reasoning frameworks, GraphRail improves error recall over generative verifiers while remaining stable under stochastic extraction. Its diagnoses can also guide online reasoning, providing a traceable way to detect and correct intermediate errors.
arxiv
GraphRail: Structured Claim Verification for Multi-Hop QA Reasoning
GraphRail is a new verification framework that represents requirements, evidence, and reasoning as structured claims and compares them without using a generative judge or gold answers. Across three multi-hop QA benchmarks and three reasoning frameworks, it improves error recall over generative verifiers while remaining stable under stochastic extraction. Its diagnoses can also guide online reasoning, providing a traceable way to detect and correct intermediate errors.
This is a concrete research contribution with benchmarked results and a novel verification approach, offering practical value for improving reasoning reliability in AI systems.
Comments & Questions (0)
No comments yet
Be the first to comment!