arXiv AI

Integrating Local and Global Entropy for Uncertainty Quantification in LLMs

arXiv:2606. 09875v1 Announce Type: cross Abstract: Large language models hallucinate confidently, making uncertainty quantification (UQ) essential for reliable deployment.

arXiv Computation and Language
Aug 28

Prediction of Prediction (PoP): Inter-Layer Activation Fusion for Single-Pass Hallucination Detection in Large Language Models

The paper introduces Prediction of Prediction (PoP), a method that fuses intermediate hidden representations across transformer layers during a single forward pass to detect hallucinations in large language models. PoP leverages internal hidden‑state transition dynamics to signal factual errors without extra decoding steps, achieving a 75.5% AUROC on the TruthfulQA benchmark with less than 1.2% added latency.

By Himal Badu
arXiv Machine Learning
Jul 23

Reading Calibrated Uncertainty from Language Model Trajectories

arXiv:2605. 22864v2 Announce Type: replace Abstract: The maximum softmax probability (MSP) represents a default approach when evaluating uncertainty quantification for language model generation with structured output.

By Aliai Eusebi, Alexander Herzog, Xiaoyu Liang, Marie Vasek, Enrico Mariconti, Lorenzo Cavallaro
arXiv AI
Jun 9

BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models

arXiv:2606. 07528v1 Announce Type: cross Abstract: Hallucination in large language models (LLMs), defined as the generation of factually incorrect or unsupported content, remains a critical barrier to reliable deployment.

By Naveen Bera, Pulijala Sai Nikhila, Kondaguduru Abhiram, Shaik Gayaz Ali, Shoaib Sadiq Salehmohamed, Shaik Mohammed Omar, Jinal Prashant Thakkar, Hansika Aredla, Shalmali Ayachit