arXiv AI

A Hierarchical Consistency Framework for Auditing Retrieval-Augmented Generation Systems

arXiv Computation and Language
Aug 27

ReliableRAG: Combating Misinformation in Retrieval-Augmented Generation via Reliability-Guided Reasoning Chains

ReliableRAG is a new framework for Retrieval-Augmented Generation that tackles misinformation in multi‑hop question answering. It extracts structured triples from retrieved documents, evaluates each triple’s reliability by combining semantic relevance to the query with credibility, and keeps only the top‑K reliable, non‑redundant triples. Using these refined triples, the system builds robust reasoning chains that filter out deceptive misinformation and produce accurate, trustworthy answers.

By Jinpu Jiang, Xuan Wu, Wenhao Song, Bo Yang, You Zhou, Hongwei Ge, Heow Pueh Lee, Yanchun Liang, Chunguo Wu
arXiv Computation and Language
Aug 28

Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG

The paper investigates whether incorporating an evidence-support signal into retrieval evaluation for retrieval‑augmented generation (RAG) improves downstream decision‑making. Across multiple benchmarks and a TREC RAG 2025 setting, the evidence signal alters retriever rankings but its benefits vary: it does not consistently enhance retriever training, its usefulness for system selection depends on generator instructions, and it does not reliably predict answer quality on unseen topics. Human filtering of evidence‑rich passages preserves useful content, yet evaluators disagree on whether this improves final answers, indicating that evidence‑aware evaluation alone does not guarantee better downstream outcomes.

By Utshab Kumar Ghosh, Debayan Mukhopadhyay, Shubham Chatterjee
arXiv AI
Sep 2

Feedback-Assisted Trust Propagation over Document Relation Graphs for Retrieval-Augmented Generation

The paper introduces TrustPropRAG, a method that builds a document relation graph to propagate reliability signals across documents in retrieval‑augmented generation systems. By anchoring this propagation with a limited set of human feedback on document reliability, the approach estimates trust scores through an optimization problem that incorporates pairwise relations and user input. These trust scores are then used to select more reliable documents and generate answers that are aware of document trustworthiness, leading to improved retrieval quality and exact match performance compared to baselines, even with sparse or noisy feedback.

By Zhuoheng Li, Ying Chen