arXiv Machine Learning By Fabrizio Frasca, Guy Bar-Shalom, Yftah Ziser, Haggai Maron

Neural Message-Passing on Attention Graphs for Hallucination Detection

Read the original on arXiv Machine Learning →

arXiv:2509. 24770v2 Announce Type: replace Abstract: Large Language Models (LLMs) often generate incorrect or unsupported content, known as hallucinations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 10

Cluster Attention for Graph Machine Learning

arXiv:2604. 07492v2 Announce Type: replace-cross Abstract: Message Passing Neural Networks have recently become the most popular approach to graph machine learning tasks; however, their receptive field is limited by the number of message passing layers.

By Oleg Platonov, Liudmila Prokhorenkova
arXiv AI
Aug 28

Rethinking Message Passing as Retrieval for Text-Attributed Graph Learning

The paper reinterprets graph neural networks (GNNs) as retrieval-augmented models, where each layer uses an MLP on a node representation and a permutation‑invariant summary of retrieved graph context instead of traditional message passing. It introduces RTA, a lightweight MLP‑based framework that replaces structural message passing with label‑aware retrieval and propagation, and provides theoretical links to softmax‑attention message passing and robustness to mis‑retrieved outliers. Experiments on text‑attributed graph benchmarks demonstrate that RTA matches or surpasses strong GNN and graph LLM baselines while improving efficiency and robustness.

By Jintang Li, Yuhong Chen, Ruofan Wu, Binli Luo, Jiayi Ji, Hui Li, Rongrong Ji
arXiv AI
Sep 21

Detecting Hallucination in LLMs: Tracing the Topological Signatures of Impaired Context Sharing

The paper investigates how the topology of attention graphs can differentiate hallucinated from non-hallucinated responses in large language models. By analyzing Forman-Ricci curvature, the authors identify structural bottlenecks and develop a method that captures both semi-local and global information-flow characteristics of attention heads associated with hallucinations. Extensive evaluation across multiple LLMs and benchmarks shows that this single-pass approach consistently outperforms existing attention-based and multi-response baselines, while also revealing that impaired context sharing—such as over-reliance on self-attention and information over-squashing—correlates strongly with hallucination occurrences.

By Amir Jalilifard, Anderson Rocha, Eric Wong, Marcos Medeiros Raimundo