Live intelligence

Latest AI updates

1 updates
Research

FondueQA Benchmark Probes How LLMs Fill Gaps in Incomplete Retrieval Evidence

Researchers introduce FondueQA, a multi-hop QA benchmark in which every required fact is uniquely localized to a designated evidence document, enabling controlled document-level evidence ablations. The design addresses benchmark contamination concerns that make it hard to tell whether correct answers under missing evidence reflect general parametric knowledge or memorization of benchmark instances. Experiments show parametric compensation depends on entity popularity and the structural role of the missing evidence, with bridging evidence sometimes more useful than the answer-bearing document. Models can recall a missing fact in isolation yet fail to use it under partial evidence, especially when plausible competing entities appear in context, reducing Exact Match by up to 15 percentage points.

LLM evaluationretrieval-augmented generationbenchmarks