The paper introduces Head-wise Modality Decoupling and Regulation (HMDR) to improve fake news detection when some modalities (image or text) are missing. HMDR first decouples modality representations via soft head grouping based on attention preference, then regulates head contributions to balance modality attention, and finally enforces modality invariance by aligning representations when one modality is replaced. Experiments on two benchmarks demonstrate that HMDR enhances detection performance under missing modalities while preserving accuracy on complete inputs.
arXiv:2606. 07651v1 Announce Type: new Abstract: Traditional fake news detection methods are falling behind as multimodal misinformation grows more advanced, seamlessly blending deceptive text, manipulated visuals, and factually incorrect claims.
arXiv:2601. 14954v3 Announce Type: replace Abstract: Social media increasingly disseminates information through mixed image text posts, but rumors often exploit subtle inconsistencies and forged content, making detection based solely on post content difficult.
The paper investigates whether multimodal large language models (MLLMs) can generate and detect realistic multimodal fake news on social media. Using a multi‑agent framework—comprising a story agent, an image agent, and a critic agent—the authors produced over 9,000 paired multimodal news posts across science, health, and entertainment domains. They benchmarked 16 open‑ and closed‑source MLLMs for automated detection and found that most models fall far short of human accuracy, especially in identifying image authenticity, highlighting the need for stronger defenses against social media fake news.
The paper introduces Inverted Asymmetric Fusion (IAF) to address strong-modality collapse in multimodal learning, where dominant modalities are degraded during fusion. IAF preserves the dominant modality by passing it unchanged and letting weaker modalities attend to it, while also strengthening weaker modalities via Modality-Aware Knowledge Distillation. Experiments on MultiHuSE, UR-FUNNY, and MUStARD show that IAF maintains unimodal performance and improves over the best unimodal baseline by up to 8.25%.
The trustworthiness of Web content faces a growing threat from multimodal fake news. Real news usually shows aligned image-text semantics, while fake news often contains a few conflicts at varying lev...
arXiv:2609.36850v1 Announce Type: new Abstract: Generative content is increasingly entering the production and dissemination of news, transforming fake news from manually fabricated or simply manipul...
arXiv:2607. 17712v1 Announce Type: new Abstract: Detecting high-level semantic concepts like negation across modalities remains a challenge for current multimodal systems.
The paper introduces TAME, a Text‑Anchored Modality Experts framework that treats language as a fixed, always‑active expert and routes audio‑textual and video‑textual cross‑modal branches as dynamic auxiliary experts. It incorporates lightweight Prophet Heads to estimate sample‑level uncertainty for each modality, guiding a reliability‑aware routing mechanism for expert aggregation. Experiments on CMU‑MOSI, CMU‑MOSEI, and CH‑SIMS show that TAME achieves state‑of‑the‑art performance while reducing parameters by up to 78.7% and FLOPs by up to 41.2% compared to a mixture‑of‑experts baseline.
arXiv:2610.20543v1 Announce Type: new Abstract: Multimodal sentiment models are usually evaluated on complete utterances, yet streams often lose a contiguous span of text, audio, or video. We study l...
The paper introduces Multi-Level Consistency and Conflict Decoupling (MLCCD), a method for detecting fake news in multimodal content by leveraging the layered knowledge of multimodal large language models (MLLMs). MLCCD first selects relevant visual and textual tokens using the MLLM’s final decision representation, then identifies tokens whose representations change sharply across adjacent layers to capture layer‑specific knowledge. Finally, it decouples this knowledge into consistency and conflict evidence, aggregating each across layers with dedicated routers that adapt to varying conflict levels, achieving superior performance on three benchmarks.
arXiv:2512.20257v2 Announce Type: replace Abstract: With the rise of easily accessible generative tools for creating and manipulating multimedia content, the threat of realistic synthetic alterations...
arXiv:2601. 11178v3 Announce Type: replace Abstract: Social media platforms are increasingly dominated by long-form multimodal content, where harmful narratives are constructed through a complex interplay of audio, visual, and textual cues.