arXiv Machine Learning By Ibne Farabi Shihab, Fariya Afrin, Sanjeda Akter, Anuj Sharma

Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG

Read the original on arXiv Machine Learning →

arXiv:2606. 00432v1 Announce Type: new Abstract: As retrieval-augmented generation (RAG) systems scale, it becomes increasingly challenging to ensure faithful grounding in external evidence.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computation and Language
Aug 25

FCPRAG: Fusion-Controller Parametric Retrieval-Augmented Generation for Stable Multi-Passage LoRA Injection

FCPRAG introduces a fusion-controlled parametric retrieval‑augmented generation framework that uses a lightweight controller to predict per‑passage fusion scores and sample‑level calibration signals, such as a mixing gate and adaptive temperature. This approach mitigates the bottleneck of evidence‑level fusion when multiple passages are retrieved, enabling selective fusion under informative signals and conservative fusion under uncertainty. Experiments on HotpotQA, 2WikiMultiHopQA, PopQA, and ComplexWebQuestions demonstrate consistent F1 improvements over standard RAG and parametric RAG baselines, with gains up to 4.65% on 2WikiMultiHopQA and 7.55% on CWQ, while also reducing tuning cost and enhancing robustness to retrieval perturbations.

By Jinchang Zhu, Jindong Li, Yi Ding, Xiaojian Nie, Rong Fu, Shuangyong Song, Haowei He, Menglin Yang
arXiv Machine Learning
Sep 10

Retrieval-augmented Decoding for Improving Truthfulness in Open-ended Generation

The paper introduces Retrieval-Augmented Decoding (RAD), a decoding-time method that improves the truthfulness of large language models without retraining. RAD uses a small reference set of up to ten annotated examples to build a grounding space of context embeddings and next-token logits, which it retrieves and aggregates during inference to shape the model’s output. Experiments on four open-ended generation benchmarks and four different LLMs show that RAD consistently outperforms strong baselines and generalizes well across tasks.

By Manh Nguyen, Sunil Gupta, Hung Le