arXiv AI August 18, 2026 By Fengji Ma, Hei Victor Cheng, Chenxing Li, Li Liu

TIMA: Text-Image Mutual Awareness for Balancing Zero-Shot Adversarial Robustness and Generalization Ability

arXiv:2405. 17678v2 Announce Type: replace-cross Abstract: Achieving zero-shot adversarial robustness without sacrificing generalization remains challenging for foundation models such as CLIP, especially under large adversarial perturbations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI

Jul 22

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

arXiv:2607. 18958v1 Announce Type: cross Abstract: While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks.

By Sibo Wang, Jie Zhang, Shiguang Shan, Xilin Chen, Wen Gao

llms nlp fine-tuning multimodal benchmarks safety

Hugging Face Trending Papers

Jul 21

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks. Existing defense methods predominantly target single-task scenarios (e.

llms nlp fine-tuning multimodal benchmarks safety

arXiv Machine Learning

Jul 13

Robustifying Vision-Language Models via Test-Time Prompt Adaptation

arXiv:2607. 09450v1 Announce Type: cross Abstract: Pre-trained Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot generalization, but their performance degrades sharply under adversarial perturbations.

By Xingyu Zhu, Huanshen Wu, Shuo Wang, Beier Zhu, Jiannan Ge, Jiaheng Zhang, Long Chen

llms multimodal safety

arXiv AI

Jun 2

Calibrating Uncertainty for Zero-Shot Adversarial CLIP

arXiv:2512. 12997v2 Announce Type: replace-cross Abstract: CLIP delivers strong zero-shot classification but remains highly vulnerable to adversarial attacks.

By Wenjing Lu, Zerui Tao, Yuning Qiu, Dongping Zhang, Yang Yang, Qibin Zhao

fine-tuning benchmarks safety

arXiv AI

Jun 10

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

arXiv:2606. 10571v1 Announce Type: cross Abstract: Adversarial examples reveal vulnerabilities in Vision-Language Pre-training (VLP) models and provide insights for improving robustness.

By Lijia Yu, Jiuxin Cao, Yuchen Qiang, Changhao Chen, Yifei Huang, Bo Liu

llms multimodal safety

arXiv Machine Learning

Jul 21

The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric

arXiv:2607. 18237v1 Announce Type: cross Abstract: Human visual similarity judgments are context-dependent.

By Sheng-Yu Wang, Yotam Nitzan, Aaron Hertzmann, Jun-Yan Zhu, Eli Shechtman, Alexei A. Efros, Richard Zhang

llms fine-tuning multimodal benchmarks

One email a morning, machine-written

Related stories

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

Robustifying Vision-Language Models via Test-Time Prompt Adaptation

Calibrating Uncertainty for Zero-Shot Adversarial CLIP

Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction

The Many Senses of Visual Similarity: A Text-Prompted Image Perceptual Metric