arXiv AI October 27, 2026 By Samarth Varshney, Ritu Yadav

TriageRAG: Failure-Aware Self-Training for Adapting Retrieval-Augmented Language Models to Specialized Domains

TriageRAG is a failure‑aware self‑training method for retrieval‑augmented language models that adapts them to specialized domains using only unlabeled text. It probes each self‑generated question with and without retrieved context, classifies the result into one of four categories (known, solved, context‑failure, retrieval‑failure), and routes each category to a tailored training signal, including a parametric route that teaches the reader to answer when retrieval misses. Experiments on 11 datasets across three domains and on CS‑Bench show that TriageRAG outperforms a budget‑matched SimRAG by 1.2–6.4 points and uniquely recovers closed‑book performance whenever retrieval harms the base model.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Aug 24

SKILL-RAG: Self-Knowledge Induced Learning and Filtering for Retrieval-Augmented Generation

arXiv:2509.20377v2 Announce Type: replace-cross Abstract: Retrieval-Augmented Generation (RAG) has significantly improved the performance of large language models (LLMs) on knowledge-intensive tasks...

By Tomoaki Isoda

llms rag nlp reinforcement-learning benchmarks safety

arXiv AI

Jun 30

AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering

arXiv:2606. 29090v1 Announce Type: cross Abstract: Retrieval-Augmented Generation (RAG) has become the standard way to ground large language models in external knowledge, yet most systems retrieve a fixed number of passages for every question regardless of its difficulty.

By Ansh Kamthan

llms rag nlp

arXiv AI

Aug 21

Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization

arXiv:2608. 20281v1 Announce Type: cross Abstract: Large language models often fail to answer questions about a bounded document collection when the source documents are not retrieved at inference time.

By Qian Kou, Xiaofeng Shi, Xiaosong Qiu, Hua Zhou

llms nlp fine-tuning benchmarks safety

Hugging Face Trending Papers

Jun 27

AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering

Retrieval-Augmented Generation (RAG) has become the standard way to ground large language models in external knowledge, yet most systems retrieve a fixed number of passages for every question regardless of its difficulty. This wastes computation on easy questions, starves hard ones, and gives no signal for when a generated answer can be trusted.

llms rag nlp

arXiv AI

Oct 1

Instruction Retrieval at Inference Time for Small Language Models

arXiv:2510.13935v3 Announce Type: replace-cross Abstract: The facts a language model stores are tied to its parameter count, so small models that fit on edge devices fail on expert problems, which ne...

By Kenan Alkiek, David Jurgens, Vinod Vydiswaran

llms fine-tuning benchmarks

arXiv Machine Learning

Sep 30

Relevance Is Not Sufficient Evidence: Detecting Evidence Gaps Before Generation in RAG

arXiv:2609.37469v1 Announce Type: cross Abstract: Retrieval-augmented generation (RAG) grounds large language models in external sources, but retrieved passages often name the right entities without...

By Suting Chen, Peichun Hua, Yunming Xiao

llms rag benchmarks

One email a morning, machine-written

Related stories

SKILL-RAG: Self-Knowledge Induced Learning and Filtering for Retrieval-Augmented Generation

AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering

Inject, Align, Recover: Staged Post-Training for Retrieval-Free Document Knowledge Internalization

AB-RAG: Adaptive Budgeted Retrieval-Augmented Generation for Reliable Question Answering

Instruction Retrieval at Inference Time for Small Language Models

Relevance Is Not Sufficient Evidence: Detecting Evidence Gaps Before Generation in RAG