The paper "Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models" evaluates ten advanced LLMs on a benchmark of 70 academic prompts across four complexity levels. Using five metrics—Accuracy, Precision, Recall, Response Deviation Index, and Hallucination Index—reviewers found that Perplexity and DeepSeek V3 achieved the highest overall accuracy, Gemini balanced recall and performance, LLaMA 3 resisted hallucinations, and Falcon had perfect precision but low recall and high deviation. The study highlights a trade‑off between response completeness and factual reliability, especially as prompt complexity increases.
By Osama Shabih, Dayam Nadeem, Shahab Saquib Sohail, Mohammad Nadeem
arXiv:2610.27247v1 Announce Type: cross
Abstract: Hallucination stress tests can yield similar average scores across language models even when different prompts elicit hallucinations in each model. W...
By Jiho Lee, Bingquan Zhang, Lin Ting Liang, Soroush Vosoughi, Weicheng Ma
The wide adoption of LLMs across broad NLG applications heightens the importance of providing users with the means to avert errors and hallucinations. Uncertainty quantification is poised to fill that...
The paper introduces DEDUCE, a three‑stage framework that turns large language models into proactive error correctors by detecting input fact errors, devising correction strategies, and delivering reliable answers. It also presents MisFactQA, a dataset of factual errors, and new metrics for robustness evaluation. Experiments on TruthfulQA, FalseQA, and MisFactQA show significant gains in accuracy and error correction across Qwen, LLaMA, and Gemma models.
By Ping Wang, Xiangguo Sun, Bingbing Xu, Guocong Li, Xiaofeng Meng
Large language models (LLMs) frequently produce confident yet factually incorrect responses when user inputs contain misleading premises, a phenomenon we attribute to fact perturbations in the input....
arXiv:2603. 09986v3 Announce Type: replace-cross Abstract: Hallucinations, the tendency for large language models to provide responses with factually incorrect and unsupported claims, is a serious problem within natural language processing for which we do not yet have an effective solution to mitigate against.
By Brandon C. Colelough, Davis Bartels, Dina Demner-Fushman