arXiv AI

Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems

The paper "Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems" updates the 2024 survey on generative AI and misinformation, shifting from a literature review to practical countermeasures. It documents changes in the threat landscape, noting that Large Language Models and multimodal systems have improved AI-generated content, thereby worsening information quality. The authors introduce JudgeGPT, a platform for assessing human perception of AI-generated news, and RogueGPT, a controlled stimulus generation engine, forming an experimental pipeline to study detection and mitigation strategies, including LLM-based detection and inoculation approaches.

arXiv AI
Sep 30

Can Multimodal Large Language Models Generate and Detect Multimodal Social Media Fake News?

The paper investigates whether multimodal large language models (MLLMs) can generate and detect realistic multimodal fake news on social media. Using a multi‑agent framework—comprising a story agent, an image agent, and a critic agent—the authors produced over 9,000 paired multimodal news posts across science, health, and entertainment domains. They benchmarked 16 open‑ and closed‑source MLLMs for automated detection and found that most models fall far short of human accuracy, especially in identifying image authenticity, highlighting the need for stronger defenses against social media fake news.

By Jiyao Yang, Yang Liu, Zhenyue Qin, Qingyu Chen, Xiuzhen Zhang
arXiv AI
Sep 28

What Improves Multimodal Misinformation Detection? Answers from a Large-Scale Empirical Study

The paper investigates how different multimodal design choices affect the performance of misinformation detection systems. Using over 3,375 experiments across three benchmark datasets and various pre‑trained vision and language models, the authors systematically compare design options and conduct robustness analyses. The study offers practical guidance on which choices improve detection, when they may fail silently, and which pipeline components most influence model behavior, addressing four key research questions.

By Akshit Sharma, Prashant W. Patil
arXiv AI
3d ago

The Verification Crisis: Expert Perceptions of GenAI Disinformation and the Case for Reproducible Provenance

The article reports on a survey of 21 experts—including AI researchers, policymakers, and disinformation specialists—about the risks posed by Generative Artificial Intelligence (GenAI) to information integrity. It finds that while deepfake videos are immediately shocking, large‑scale text generation threatens to create systemic epistemic fragmentation and synthetic consensus, especially in politics. Experts express doubt about current detection tools and instead advocate for provenance standards and regulatory frameworks, emphasizing the need for reproducible research methods and standardized benchmarks to effectively counter synthetic media.

By Alexander Loth, Martin Kappes, Marc-Oliver Pahl
arXiv AI
Sep 28

A Survey on Fake Review Detection: From Pre-trained Language Models to Large Language Models

The article surveys fake review detection research, focusing on how pre‑trained language models (PLMs) and large language models (LLMs) influence both the generation of deceptive reviews and their detection. It reviews 211 studies from 2018 to early 2026, categorizing methods by evidence source—such as review text, sentiment, rating behavior, temporal metadata, user‑product graphs, multimodal content, external knowledge, and LLM‑generated signals—and by fusion level. The survey traces the evolution from traditional machine learning to PLM‑based and LLM‑based approaches, evaluates performance on Amazon, Yelp, and OpSpam benchmarks, and highlights open challenges including adversarial generation, cross‑domain transfer, uncertainty‑aware fusion, robustness to missing sources, interpretability, and trustworthy evaluation of AI‑generated deceptive content.

By Fanji Yang (Guizhou University of Finance and Economics), Huiyao Chen (Harbin Institute of Technology), Xi Yu (Guizhou University of Finance and Economics), Meishan Zhang (Harbin Institute of Technology), Xiaohong Xiao (Guizhou University of Commerce), Mingsen Deng (Guizhou University of Finance and Economics)