arXiv AI
Jun 9

BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models

arXiv:2606. 07528v1 Announce Type: cross Abstract: Hallucination in large language models (LLMs), defined as the generation of factually incorrect or unsupported content, remains a critical barrier to reliable deployment.

By Naveen Bera, Pulijala Sai Nikhila, Kondaguduru Abhiram, Shaik Gayaz Ali, Shoaib Sadiq Salehmohamed, Shaik Mohammed Omar, Jinal Prashant Thakkar, Hansika Aredla, Shalmali Ayachit
arXiv Computation and Language
Oct 21

Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models

The paper "Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models" evaluates ten advanced LLMs on a benchmark of 70 academic prompts across four complexity levels. Using five metrics—Accuracy, Precision, Recall, Response Deviation Index, and Hallucination Index—reviewers found that Perplexity and DeepSeek V3 achieved the highest overall accuracy, Gemini balanced recall and performance, LLaMA 3 resisted hallucinations, and Falcon had perfect precision but low recall and high deviation. The study highlights a trade‑off between response completeness and factual reliability, especially as prompt complexity increases.

By Osama Shabih, Dayam Nadeem, Shahab Saquib Sohail, Mohammad Nadeem