arXiv AI

Automatic Model Card Generation Using an LLM

arXiv AI
Jun 9

BEACON: Behavioral Entropy Aggregation for Cross-Model Hallucination Detection in Large Language Models

arXiv:2606. 07528v1 Announce Type: cross Abstract: Hallucination in large language models (LLMs), defined as the generation of factually incorrect or unsupported content, remains a critical barrier to reliable deployment.

By Naveen Bera, Pulijala Sai Nikhila, Kondaguduru Abhiram, Shaik Gayaz Ali, Shoaib Sadiq Salehmohamed, Shaik Mohammed Omar, Jinal Prashant Thakkar, Hansika Aredla, Shalmali Ayachit
arXiv Computation and Language
Oct 21

Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models

The paper "Fluent but Fallible: Benchmarking Hallucination and Factual Reliability in Large Language Models" evaluates ten advanced LLMs on a benchmark of 70 academic prompts across four complexity levels. Using five metrics—Accuracy, Precision, Recall, Response Deviation Index, and Hallucination Index—reviewers found that Perplexity and DeepSeek V3 achieved the highest overall accuracy, Gemini balanced recall and performance, LLaMA 3 resisted hallucinations, and Falcon had perfect precision but low recall and high deviation. The study highlights a trade‑off between response completeness and factual reliability, especially as prompt complexity increases.

By Osama Shabih, Dayam Nadeem, Shahab Saquib Sohail, Mohammad Nadeem
arXiv Computer Vision
Oct 19

From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images

The paper introduces the Deepfake Face Artifact Taxonomy (DFAT) and uses it to create both general-purpose and model-specific training materials for detecting deepfake face images. An online experiment with 524 participants tested detection accuracy across five generative models—three GANs, one diffusion model, and one multimodal large language model (GPT‑5)—showing that detection performance varies strongly by model and that model‑specific training yields greater gains than general training. A five‑month follow‑up with 342 participants revealed stable detection accuracy and no increase in perceived stress, suggesting the training’s durability.

By Zhiqing Guo, Lixin Jia, Luning Sun, Xiaowei Chen, Guofeng Yu, Liejun Wang, Gaobo Yang, David Stillwell, Thorsten Holz, Shujun Li
arXiv AI
Sep 15

Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations

The article surveys hallucination issues in Large Vision‑Language Models (LVLMs), a type of multimodal foundation model that blends visual data with large language models. It categorizes hallucination causes into model architecture and data quality, presents a taxonomy of mitigation strategies, and critically evaluates existing evaluation benchmarks from both discriminative and generative viewpoints. The survey also outlines open challenges and future research directions to improve LVLM reliability and trustworthiness.

By Yinghao Guo, Wei Lan, Wenyi Chen, Qingfeng Chen, Shichao Zhang, Shirui Pan, Huiyu Zhou, Yi Pan
arXiv AI
Sep 10

Evidence-Aligned Entity Verification for Hallucination Detection in Retrieval-Augmented Generation

The paper introduces Evidence-Aligned Entity Verification (EAEV), a method for detecting entity-level hallucinations in retrieval-augmented generation (RAG). EAEV aligns generated entities with retrieved evidence across three dimensions and uses counterfactual stability analysis to maintain robust alignments when evidence changes. Experiments on multiple RAG benchmarks show that EAEV consistently outperforms existing hallucination detection methods and generalizes well.

By Runsong Jia, Zhen Fang, Mengjia Wu, Jie Lu, Yi Zhang