The paper introduces TRAILS, a taxonomy of 38 mechanisms that can compromise the reliability of large language model (LLM) read‑and‑evaluate tasks in evidence synthesis, such as study screening, data extraction, risk‑of‑bias assessment, and critical appraisal. It explains how these mechanisms can cause inconsistent or hidden failures across repeated LLM runs and outlines deployment settings, testing approaches, and mitigation strategies for each. The authors argue that repeatability or accuracy alone does not guarantee trustworthy judgments, emphasizing the need for human evaluation to verify that decisions are evidence‑based, free from external influence, and reproducible.
By Carole Lunny, Ian Goodman, Stefano Berrone, Connor TA Brenna, Emma K Reid, Ivan Perez-Neri, Shailesh Kolekar, Nityanand Jain, Ashwin Kamath, Lucas HCC Santos, Yulia Otmakhova, Heba Hussein, Diana M Cespedes, Gioia Dahdal, Salmaan Kanji
arXiv:2609.32807v2 Announce Type: replace
Abstract: Clinical LLM evaluation often emphasizes answer accuracy; however, accuracy alone does not test counterfactual consistency or demographic robustnes...
By Chaitali Deb Purkayastha, Bharath Kumar Bolla, Vishnu Surya Reddy Nandi
The paper studies how on‑policy distillation (OPD) can improve answer accuracy while reducing a model’s reliance on supporting evidence. Through matched document interventions, the authors identify an "evidence bypass" phenomenon where a student model keeps an originally correct answer even after the supporting document is changed. They propose Evidence‑Paired OPD (EP‑OPD), which uses matched documents and an answer‑level margin to recover most of the counterfactual accuracy lost by standard OPD while preserving much of its original‑document accuracy gains.
By Ruoran Xu, Yilun Zhao, Ziyu Chen, Xiaoqiang kang, Arman Cohan
arXiv:2605. 03534v2 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) grounds answers in retrieved passages, yet relevance does not guarantee sufficiency: a topical passage may still fail to justify the answer.
By Jingxi Qiu, Zeyu Han, Cheng Huang
The paper introduces SEAC, a method that augments a fixed fact verifier with a lightweight evidence‑acquisition policy to decide when to stop or request more evidence. SEAC evaluates each claim by retrieving evidence, running the verifier, and estimating a clarification‑utility score that balances the benefit of additional evidence against its cost. Experiments on SciFact, LIAR, and FEVER show that SEAC improves mean accuracy and macro‑F1 compared to existing fact‑verification and active‑retrieval baselines.
By Yuhang Dong, Jinghong Li, Xinyue Wang, Yuanning Cui
arXiv:2606. 23915v1 Announce Type: cross Abstract: Practice often treats automatic metrics for attribution in LLM retrieval-augmented generation as interchangeable.
By Tianyu Ding, Aditya Nannapaneni, Juan Pablo De la Cruz Weinstein