arXiv Machine Learning August 6, 2026 By Yiming Chen, Kemou Li, Haiwei Wu, Jiantao Zhou

When Modalities Fail to Tango: Conformal Backdoor Detection in Multimodal Contrastive Learning

Read the original on arXiv Machine Learning →

arXiv:2608. 04052v1 Announce Type: cross Abstract: Backdoor attacks in multimodal contrastive learning (MCL) have garnered growing attention in recent years, as many downstream tasks critically depend on pre-trained MCL models.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

multimodal

arXiv Computer Vision

Sep 22

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

arXiv:2511.18921v2 Announce Type: replace Abstract: Backdoor attacks undermine the reliability and trustworthiness of machine learning systems by injecting hidden behaviors that can be maliciously ac...

By Juncheng Li, Yige Li, Hanxun Huang, Yunhao Chen, Xin Wang, Yixu Wang, Xingjun Ma, Yu-Gang Jiang

llms nlp multimodal benchmarks safety

arXiv Machine Learning

Aug 14

Adjustable Text-Guided Backdoor Attacks with Natural-Word Triggers on Multimodal Pretrained Models

arXiv:2604. 05809v2 Announce Type: replace-cross Abstract: This paper presents Text-Guided Backdoor (TGB), an adjustable backdoor attack against multimodal pretrained models that uses natural-word triggers, namely words that can naturally occur in ordinary textual inputs.

By Yiyang Zhang, Chaojian Yu, Ziming Hong, Yuanjie Shao, Qinmu Peng, Tongliang Liu, Xinge You

nlp multimodal safety

arXiv AI

Jul 2

Text Over Image: Auditing Multimodal Robustness in Synthetic Medical Image Detection

arXiv:2606. 25375v2 Announce Type: replace-cross Abstract: With the rapid adoption of generative AI, synthetic medical images pose growing risks, including diagnostic deception and insurance fraud.

By Ching-Hao Chiu, Hao-Wei Chung, Gelei Xu, Xueyang Li, Pin-Yu Chen, John Kheir, Meysam Ghaffari, Carlos Morato, Ahmed Abbasi, Yiyu Shi

llms multimodal benchmarks

Hugging Face Trending Papers

Jun 2

Investigating Adversarial Robustness of Multi-modal Large Language Models

Multi-modal Large Language Models (MLLMs) achieve strong performance on vision-language tasks, but incorporating visual inputs through a vision encoder (e. g.

llms rag fine-tuning multimodal safety

arXiv AI

Jun 15

MirrorCheck: Efficient Adversarial Defense for Vision-Language Models

arXiv:2406. 09250v5 Announce Type: replace-cross Abstract: Vision-Language Models (VLMs) are increasingly susceptible to sophisticated adversarial attacks, including adaptive strategies specifically designed to bypass existing defenses.

By Samar Fares, Klea Ziu, Toluwani Aremu, Nikita Durasov, Martin Tak\'a\v{c}, Pascal Fua, Ivan Laptev, Karthik Nandakumar

llms rag diffusion multimodal safety

arXiv AI

Aug 5

Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs

arXiv:2608. 00076v2 Announce Type: replace-cross Abstract: Multimodal large language models (MLLMs) increasingly support high-stakes decision making by combining complementary information from images and text.

By Vahidin Hasic, Chao Wang, Luis C. Garcia-Peraza-Herrera, David Watson, Senka Krivic

llms diffusion multimodal benchmarks safety

One email a morning, machine-written

Related stories

BackdoorVLM: A Benchmark for Backdoor Attacks and Defenses on Vision-Language Models

Adjustable Text-Guided Backdoor Attacks with Natural-Word Triggers on Multimodal Pretrained Models

Text Over Image: Auditing Multimodal Robustness in Synthetic Medical Image Detection

Investigating Adversarial Robustness of Multi-modal Large Language Models

MirrorCheck: Efficient Adversarial Defense for Vision-Language Models

Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs