arXiv AI
Attention-space Contrastive Guidance for Efficient Hallucination Mitigation in LVLMs
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Computation and Language
Oct 15
Mitigating Video Hallucinations via Attention-Guided Representation Perturbation
arXiv:2610.19728v1 Announce Type: cross Abstract: Video large language models (Video LLMs) often generate responses unsupported by the input video. Contrastive decoding (CD) can mitigate these halluc...
arXiv AI
Sep 2
Revealing Multi-View Hallucination in Large Vision-Language Models
The paper introduces the concept of multi-view hallucination (MVH), where large vision-language models produce incorrect answers when processing images from multiple viewpoints. It presents MVH-Bench, a benchmark of 4.8k question-answer pairs that target cross-instance and cross-view hallucinations, and shows that MVH is common across recent models. The authors propose Reference Shift Contrastive Decoding (RSCD), a training-free decoding method that mitigates visual interference, achieving significant performance gains on MVH-Bench with LLaVA-OneVision and Qwen2.5-VL.
arXiv Computation and Language
Oct 9
SAGE: Sink-Aware Guided Emphasis for Visual Grounding in Vision-Language Decoders
The paper introduces SAGE, a lightweight method that guides decoder attention in vision-language models away from prompt‑invariant attention sinks (PIS) toward query‑dependent regions of interest (ROIs). By using token‑aligned ROI masks from vision backbones like CLIP, ViT, and DINOv3, SAGE improves visual grounding and reduces hallucinations across various VLM families. Experiments show consistent gains on public vision‑language benchmarks, especially in fine‑grained visual discrimination tasks where localized evidence is essential.
arXiv AI
Jun 24
When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
arXiv:2605. 08245v4 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) increasingly power high-stakes applications, from medical imaging to autonomous systems, yet they routinely hallucinate, confidently describing content not present in the input.
arXiv AI
Jul 1
ADAPT: Attention Dynamics Alignment with Preference Tuning for Faithful MLLMs
arXiv:2606. 31054v1 Announce Type: cross Abstract: Multimodal Large Language Models (MLLMs) are critically hampered by hallucination, generating content inconsistent with the provided image.
arXiv AI
Jun 30
FADE: Mitigating Hallucinations by Reducing Language-Prior Dominance in Large Vision-Language Models
arXiv:2606. 29431v1 Announce Type: new Abstract: Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucination, generating content inconsistent with the input image.