The Flow has not summarised this story yet — read it at arXiv Computer Vision.
MiD-VLM is a multimodal model that detects and grounds global semantic misinformation in image-caption pairs. It combines image-text representations from SigLIP with visual scene features from DINOv2, and adapts Qwen2‑VL‑7B using LoRA to jointly predict authenticity, identify manipulation type, and localize misleading caption tokens. On the DGM4+ validation split, it achieves an F1 score of 0.9679 for binary authenticity classification.
The paper investigates how different multimodal design choices affect the performance of misinformation detection systems. Using over 3,375 experiments across three benchmark datasets and various pre‑trained vision and language models, the authors systematically compare design options and conduct robustness analyses. The study offers practical guidance on which choices improve detection, when they may fail silently, and which pipeline components most influence model behavior, addressing four key research questions.
arXiv:2606. 24112v1 Announce Type: new Abstract: Multimodal misinformation detection is increasingly important because viral posts now combine long multilingual narratives, several images, mixed provenance, and subtle text--image framing errors.
arXiv:2601. 14954v3 Announce Type: replace Abstract: Social media increasingly disseminates information through mixed image text posts, but rumors often exploit subtle inconsistencies and forged content, making detection based solely on post content difficult.
arXiv:2608. 09122v1 Announce Type: cross Abstract: The localized depiction of perceptual quality has long been a crucial, yet underexplored, challenge in image quality assessment (IQA).
arXiv:2606. 03066v1 Announce Type: new Abstract: The rapid rise of generative AI has made multimodal fake news increasingly realistic and pervasive, posing severe threats to public trust and social stability.