arXiv Machine Learning July 28, 2026 By Shishen Gu, Jiequan Cui, Wenbo Hu, Zenglin Shi, Zhenzhen Hu, Richang Hong

Visual Token Compression Enhances Robustness of MLLMs

Read the original on arXiv Machine Learning →

arXiv:2607. 22716v1 Announce Type: cross Abstract: In this paper, we show for the first time that visual token pruning enhances the robustness of Multimodal Large Language Models (MLLMs), mitigating vulnerabilities such as jailbreak attacks and hallucinations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 9

MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language Models

arXiv:2606. 07706v1 Announce Type: cross Abstract: Vision-Language Models (VLMs) have demonstrated strong performance across multimodal tasks, yet their safety robustness remains an open challenge.

By Rishabh Makwana, Mamta, Deeksha Varshney, Oana Cocarascu

llms multimodal benchmarks safety

arXiv AI

Sep 1

Robustness of Vision Language Models Against Split-Image Harmful Input Attacks

arXiv:2602.08136v2 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are now a core part of modern AI. Recent work proposed several visual jailbreak attacks using single/ holistic...

By Md Rafi Ur Rashid, MD Sadik Hossain Shanto, Vishnu Asutosh Dasu, Shagufta Mehnaz

llms reinforcement-learning fine-tuning efficiency multimodal benchmarks safety

arXiv Computer Vision

Sep 22

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously ac...

By Juncheng Li, Yige Li, Hanxun Huang, Yunhao Chen, Xin Wang, Yixu Wang, Xingjun Ma, Yu-Gang Jiang

llms nlp multimodal benchmarks safety

arXiv Computer Vision

3d ago

Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

arXiv:2609.39134v1 Announce Type: new Abstract: Visual-token compression improves the efficiency of large vision-language models, but can expose failures that full-token evaluation misses. We study a...

By Shilinlu Yan, Bowen Chen, Yuechen Zhang, Zhenhong Zhou, Li Sun, Sen Su

llms multimodal safety

arXiv AI

Sep 2

SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models

SinkPruner is a training‑free framework that prunes visual tokens for multimodal large language models by first removing high‑norm redundant tokens with a visual sanitizer and then selectively keeping tokens that align with the text query using a text‑guided pruner. The coarse‑to‑fine design reduces attention sink and dispersion, enabling an 89% token reduction while preserving 96.5% of LLaVA‑1.5’s performance and 91.8% of Qwen2.5‑VL’s performance across twelve image‑language and four video‑language benchmarks. The visual sanitizer also improves existing pruning methods, showing strong transferability.

By Shiyu Li, Zi-Yuan Hu, Shijia Huang, Yanyang Li, Yiwu Zhong, Liwei Wang

llms efficiency multimodal benchmarks

arXiv AI

Jun 2

Jailbreaking Multimodal Large Language Models using Multi-Clip Video

arXiv:2606. 02111v1 Announce Type: cross Abstract: As multimodal large language models (MLLMs) have advanced to process video inputs, concerns have emerged about their potential for malicious misuse.

By Choongwon Kang, Seungjong Sun, Hyunmin Jun, Jang Hyun Kim

llms multimodal safety

One email a morning, machine-written

Related stories

MLingualFC: Evaluating Jailbreak Vulnerabilities in Multilingual Vision-Language Models

Robustness of Vision Language Models Against Split-Image Harmful Input Attacks

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models

SinkPruner: Sink-Free Visual Token Pruning for Multimodal Large Language Models

Jailbreaking Multimodal Large Language Models using Multi-Clip Video