C$^2$U in RAG: Compositional Concept Unlearning in Retrieval-Augmented Generation
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The paper investigates the costs of hybrid retrieval—combining a sparse lexical retriever with a dense neural one—across seven BEIR datasets and multiple fusion strategies. It finds that even the best fusion method can rank relevant documents worse than either component alone on a substantial fraction of queries, a phenomenon dubbed the "fusion tax." The tax is largely a ranking effect that preserves overall recall but harms individual query performance, especially when only one retriever covers a query.
arXiv:2610.29722v1 Announce Type: new Abstract: Retrieval Augmented Generation (RAG) grounds large language models in external knowledge. Modern pipelines combine embedding, chunking, retrieval, rera...
arXiv:2606.11350v2 Announce Type: replace Abstract: Retrieval-augmented generation (RAG) degrades when applied to large, heterogeneous document collections. In RAG systems, dense similarity becomes l...
The paper investigates modular entity disambiguation by separating candidate retrieval from entity selection. It compares sparse retrieval (BM25), Web KB search, and a dense retriever, all paired with large language model selectors. Results show that a training‑free BM25 retriever combined with an LLM selector achieves state‑of‑the‑art performance on the ZELDA benchmark, and the modular approach enables abstention when retrieval fails.
arXiv:2609.22100v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) improves language models with retrieved evidence, but processing many long passages is costly and can introduce...
arXiv:2606.16661v2 Announce Type: replace-cross Abstract: Fixed-length chunking in Retrieval-Augmented Generation (RAG) often leads to boundary fragmentation, where critical evidence is split across...