arXiv Machine Learning June 11, 2026 By Narges Babadi, Hadis Karimipour

Right Predictions, Misleading Explanations: On the Vulnerability of Vision-Language Model Explanations

Read the original on arXiv Machine Learning →

arXiv:2605. 16651v2 Announce Type: replace-cross Abstract: Explanation mechanisms are increasingly used to support transparency and trust in vision-language models (VLMs), particularly in settings where model decisions require human oversight.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 11

Diffusion-based Cumulative Adversarial Purification for Vision Language Models

arXiv:2506. 03933v2 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have shown remarkable capabilities in multimodal understanding, yet their susceptibility to adversarial perturbations poses a significant threat to their reliability in real-world applications.

By Jia Fu, Yongtao Wu, Yihang Chen, Kunyu Peng, Xiao Zhang, Volkan Cevher, Sepideh Pashami, Anders Holst

llms rag diffusion multimodal safety

Hugging Face Trending Papers

Jun 2

Investigating Adversarial Robustness of Multi-modal Large Language Models

Multi-modal Large Language Models (MLLMs) achieve strong performance on vision-language tasks, but incorporating visual inputs through a vision encoder (e. g.

llms rag fine-tuning multimodal safety

arXiv AI

Jun 10

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

arXiv:2606. 10571v1 Announce Type: cross Abstract: Adversarial examples reveal vulnerabilities in Vision-Language Pre-training (VLP) models and provide insights for improving robustness.

By Lijia Yu, Jiuxin Cao, Yuchen Qiang, Changhao Chen, Yifei Huang, Bo Liu

llms multimodal safety

arXiv AI

Jun 24

PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models

arXiv:2606. 24388v1 Announce Type: new Abstract: We introduce a large-scale, open-source dataset of pre-generated adversarial attacks for vision-language models (VLMs).

By Simone Gallivanone, Hossein Khodadadi, Mauro Dore, Mauro Medda, Nicola Franco

llms fine-tuning multimodal benchmarks safety

Hugging Face Trending Papers

Jul 21

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks. Existing defense methods predominantly target single-task scenarios (e.

llms nlp fine-tuning multimodal benchmarks safety

arXiv AI

Jul 22

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

arXiv:2607. 18958v1 Announce Type: cross Abstract: While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks.

By Sibo Wang, Jie Zhang, Shiguang Shan, Xilin Chen, Wen Gao

llms nlp fine-tuning multimodal benchmarks safety

Related stories

Diffusion-based Cumulative Adversarial Purification for Vision Language Models

Investigating Adversarial Robustness of Multi-modal Large Language Models

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model