Back to AI News
arxiv

StitchRAG Builds Compact RAG Contexts by Stitching Sentences with Text Diffusion

StitchRAG is a framework for constructing compact contexts in retrieval-augmented generation, aiming to cut the computational overhead of long retrieved passages while avoiding noise that can hurt performance. It sets a per-passage size reduction ratio through a utility maximization that trades retained information against computation cost, then extracts answer candidates and query-related keywords as anchors and collects passage sentences containing them. The collected sentences are linked together using text diffusion to form a coherent context. Experiments on five open-domain QA benchmarks report consistent gains over multi-step and compression baselines, with ablations supporting dynamic size allocation, anchor preservation and diffusion-based stitching.

AI Brief

It offers a concrete, ablated method for shrinking RAG inputs without discarding the evidence sentences answers depend on, which is directly useful to teams building retrieval pipelines.

arXiv:2611.22766v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) improves factuality by grounding large language models (LLMs) in external evidence. However, long retrieved contexts incur computational overhead and can even hurt performance due to noisy or irrelevant content. We propose \textsc{StitchRAG}, a framework for constructing compact context in RAG. \textsc{StitchRAG} builds a faithful, information-dense context while dynamically compressing the retrieved passages. We adapt the size reduction ratio to each passage by formulating a utility maximization trading-off the retained information and computation costs. We then extract answer candidates and query-related keywords from passages as anchors and collect passage sentences containing anchors under the derived size constraint. Finally, we connect or stitch the collected sentences together using text diffusion to form a coherent and natural context. Experiments on five open-domain QA benchmarks show that \textsc{StitchRAG} consistently outperforms diverse multi-step and compression baselines. Extensive ablations show the effectiveness of dynamic size allocation, anchor preservation, and diffusion-based stitching.
Be the first to rate this article.

Comments & Questions (0)

Captcha
Please be respectful — let's keep the conversation friendly.

No comments yet

Be the first to comment!