arXiv AI

GRACE: Graph-Grounded Reflective Agent Copilot Engine for Expert-in-the-Loop Knowledge Expansion

The paper introduces GRACE, a framework that breaks down large language model (LLM) responses into atomic claims and grounds them against trusted knowledge priors using a weighted bipartite graph. Edge weights enable weighted centrality analysis to classify claims as Grounded, Refuted, or Boundary, identifying hallucinations and frontier knowledge. An objective called Return on Attention (RoA) prioritizes expert review only for high‑uncertainty claims, and verified claims become new evidence anchors, creating a loop that expands the knowledge base across iterations.

arXiv AI
Jun 16

VeriGraph: Towards Verifiable Data-Analytic Agents

arXiv:2606. 16603v1 Announce Type: cross Abstract: LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit.

By Jiajie Jin, Zhao Yang, Wenle Liao, Yuyang Hu, Guanting Dong, Xiaoxi Li, Yutao Zhu, Zhicheng Dou
arXiv AI
Aug 11

Bounding Hallucinations: Merlin-Arthur Protocols for Mutual-Information Bounds in Language Models

arXiv:2512. 11614v3 Announce Type: replace-cross Abstract: Retrieval-augmented generation (RAG) relies on retrieved context to guide large language models (LLM), yet treats the retrieval as a heuristic rather than verifiable evidence -- leading to unsupported answers, hallucinations, and reliance on spurious context.

By Bj\"orn Deiseroth, Max Henning H\"oth, Kristian Kersting, Letitia Parcalabescu
arXiv Machine Learning
Sep 29

Parameters vs. Context: TRACE Fine-Tuning for Robust Retrieval-Augmented Generation

The paper introduces TRACE, a fine‑tuning framework for Retrieval‑Augmented Generation (RAG) that addresses conflicts between retrieved knowledge and a model’s internal knowledge. TRACE uses multi‑agent debate traces to identify correct and incorrect candidates and answer‑shift patterns, providing fine‑grained supervision for reliable knowledge‑source selection. It also incorporates an answer‑completeness regularization mechanism to prevent empty, overly short, or prematurely terminated responses, thereby improving robustness against misleading retrieved content and enhancing answer quality.

By Zhengchen Huang, Yundong Sun, Minrui Song, Shuanglong Yao, Ye Liu, Ji Chen, Xing Wang
arXiv AI
Oct 28

Clearing the FoG: Training KG Agents to Retrieve the Evidence Behind Their Answers

The paper introduces FoG, a framework that trains knowledge graph (KG) agents to retrieve the evidence behind their answers. FoG combines evidence‑grounded synthesis, a KG interaction agent, and an evidence‑coverage process reward (ECPR) to ensure that every answer is supported by retrieved triples. Experiments on three KGQA benchmarks show that 3B–4B open‑source agents trained with FoG outperform larger baselines in both answer accuracy and evidence coverage, even with zero‑shot cross‑KG transfer.

By Zongyuan Sun, Shuai Zhao, Yingjun Du, Ke Shu, Ziyue Zhu, Haoran Luo
arXiv AI
Oct 28

Tracing the Cascade: A Topology-Aware Evaluation Framework for Scientific Agent Hallucinations

The paper introduces SCHEMA, a topology‑aware evaluation framework designed to assess hallucinations in large language model agents used for scientific research. SCHEMA builds scientific concept graphs from benchmark seeds and literature evidence, then generates graph‑grounded tasks such as claim verification, multi‑hop reasoning, open‑ended explanation, and experimental code generation. It evaluates agents using a trajectory hallucination pipeline that assigns a topology‑weighted severity score and a multi‑agent counterfactual attribution module that identifies the causal mechanisms behind failures. The study finds that hallucinations tend to cluster around highly connected knowledge hubs and that a model’s final accuracy can be misleading, as correct answers may arise from structurally flawed reasoning. "whyItMatters":"The findings highlight that terminal accuracy alone is insufficient for high‑stakes scientific applications, underscoring the need for mechanism‑level evaluation grounded in knowledge topology."

By Xinshun Feng, Ziqi Miao, Lijun Li, Jing Shao