The paper introduces Information-Guided Frontier Decoding (IGFD), a training‑free strategy for diffusion multimodal language models that prioritizes the commitment of reliable semantic tokens over fragile structural ones. IGFD ranks candidates by token confidence, neighborhood uncertainty, and structural commitment risk, and uses a dynamic frontier to limit selection to locally expandable regions. Across multiple multimodal benchmarks, IGFD consistently outperforms existing decoding methods while requiring no extra training or forward passes.
By Xingyou Fang, Jingxing Zhong, Xiaosong Yuan, Xiaofeng Zhang
arXiv:2606. 07647v1 Announce Type: cross Abstract: Large vision language models (LVLMs) have made rapid advancements and are deployed across various applications, yet hallucinations remain a major challenge.
By Ruipeng Zhang, Zhihao Li, C. L. Philip Chen, Tong Zhang
The paper introduces RVSD, a training‑free, plug‑and‑play decoding framework that combines token sparsification with Semantic‑Space Visual Retrieval (SSVR) to reduce visual hallucinations in large vision‑language models. RVSD employs a semantics‑directed token selection strategy to prune redundant tokens while preserving essential visual information, and uses SSVR to perform on‑demand cross‑modal retrieval within a shared semantic space. Experiments show that RVSD achieves state‑of‑the‑art performance in mitigating visual hallucinations while maintaining strong suppression in long‑context generation.
By Canjie Liu, Jiawen Kang, Jinbo Wen, Zishao Zhong
arXiv:2605. 18160v2 Announce Type: replace-cross Abstract: In recent years, multimodal large language models (MLLMs) have achieved remarkable progress, primarily attributed to effective paradigms for integrating visual and textual information.
By Xinpeng Dong, Min Zhang, Kairong Han, Xu Tan, Fei Wu, Kun Kuang
ReWEIGH the Evidence is a training‑free decoding technique that calibrates token‑level ordinal visual evidence to reduce hallucinations in large vision‑language models. It aggregates vocabulary ranks across visual positions, compares candidates to a token‑specific reference derived from unlabeled images, and applies a bounded penalty only when evidence falls below this reference. Experiments on four 7B backbones show up to a 21.3% reduction in hallucinated object mentions while largely preserving or improving descriptive and general performance, with minimal added latency.
By Jihae Jeong, Junha Choi, Hwanjo Yu
arXiv:2605. 25820v2 Announce Type: replace Abstract: Diffusion-based multimodal large language models (dMLLMs) decode by iteratively predicting tokens at multiple masked positions in parallel.
By Yulin Yuan, Hongshuo Zhao, Xiangming Meng
arXiv:2606. 16847v1 Announce Type: cross Abstract: Diffusion Large Language Models (dLLMs) offer a promising avenue for parallel generation but face a trade-off between decoding speed and quality.
By Yizhen Yao, Qinglin Zhu, Runcong Zhao, Xiangxiang Dai, Yanzheng Xiang, Yulan He, Lin Gui
arXiv:2610.23290v1 Announce Type: new
Abstract: Diffusion-based multimodal large language models (dMLLMs) decode by iterative denoising with bidirectional attention, which precludes the standard auto...
By Qiyan Zhao, Xiaofeng Zhang, Xu-Yao Zhang, Shijie Han, Zhepeng Li, Shunzhi Zhu, Da-Han Wang
arXiv:2609.16646v1 Announce Type: new
Abstract: When strong multimodal models are widely available, progress requires new scientific methodologies beyond benchmark scores---using models as instrument...
By Zhipeng Zhao, Wenxu Wang, Peishun Liu, Ruichun Tang
arXiv:2608. 10835v1 Announce Type: cross Abstract: Large Vision-Language Models (LVLMs) achieve impressive visual reasoning and dialogue capabilities, yet frequently hallucinate content unsupported by the visual input.
By Dvir Samuel, Guy Bar-Shalom, Fabrizio Frasca, Ethan Fetaya, Yftah Ziser, Gal Chechik, Haggai Maron
arXiv:2606. 00819v1 Announce Type: new Abstract: Large Language Models (LLMs) have achieved strong performance across diverse natural language tasks, yet their outputs often suffer from hallucinations -- content that is misaligned with factual information.
By Hanze Li, Jinhao You, Yichen Guo, Kai Tang, Shuangyang Xie, Xiande Huang
arXiv:2602.06652v2 Announce Type: replace
Abstract: The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions r...
By Farooq Ahmad Wani, Alessandro Suglia, Rohit Saxena, Aryo Pradipta Gema, Wai-Chung Kwan, Fazl Barez, Maria Sofia Bucarelli, Fabrizio Silvestri, Pasquale Minervini