CLADE Shows RAG Models Guess From Coarse Evidence Instead of Abstaining
Researchers identify a failure mode called CLADE, where retrieval-augmented language models answer from passages that mention only a broader category rather than the specific answer required. On biomedical questions from PrimeKG, family-only passages reduced abstention by 13.8 points versus uninformative passages, and the resulting guesses were wrong about half the time. A counterfactual test replacing an exact disease name with its broader family lowered abstention by 17.4 points, while confidence filtering, larger models, and abstention instructions did not resolve the issue. Ontology-assisted recovery improved end-to-end performance from 10.0% to 26.8%, but identifying the correct family on the page remained a bottleneck.