arXiv AI
Jul 10
Adversarial Decoys: Misdirecting Attention-Based Defenses in ViT
arXiv:2607. 07922v1 Announce Type: cross Abstract: Vision Transformers (ViTs) remain vulnerable to localized adversarial attacks, e.
A Mechanistic Analysis of Adversarial Fine-tuning of Vision Transformers
arXiv:2606. 07593v1 Announce Type: cross Abstract: The widespread use of image classification models in high-risk, real-world situations necessitates making these models robust to slight disturbances or perturbations, such as blurring or sharpening, in the input images.
Related stories
arXiv AI
Jun 11
Diffusion-based Cumulative Adversarial Purification for Vision Language Models
arXiv:2506. 03933v2 Announce Type: replace-cross Abstract: Vision Language Models (VLMs) have shown remarkable capabilities in multimodal understanding, yet their susceptibility to adversarial perturbations poses a significant threat to their reliability in real-world applications.
arXiv AI
Jun 10
Improving Adversarial Transferability on Vision-Language Pre-training Models via Surrogate-Specific Bias Correction
arXiv:2606. 10571v1 Announce Type: cross Abstract: Adversarial examples reveal vulnerabilities in Vision-Language Pre-training (VLP) models and provide insights for improving robustness.
arXiv Machine Learning
Aug 10
Corrupting Attention: Evasion-Based Adversarial Attacks on Encoder Attention in Detection Transformers
arXiv:2608. 06674v1 Announce Type: cross Abstract: Adversarial vulnerabilities remain a major concern for the safe deployment of neural networks, particularly in object detection, a core task embedded in many safety-critical systems.
Hugging Face Trending Papers
Jun 2
Investigating Adversarial Robustness of Multi-modal Large Language Models
Multi-modal Large Language Models (MLLMs) achieve strong performance on vision-language tasks, but incorporating visual inputs through a vision encoder (e. g.
arXiv Machine Learning
Jun 4
Vision Transformer Finetuning Benefits from Non-Smooth Components
arXiv:2602. 06883v3 Announce Type: replace Abstract: The smoothness of the transformer architecture has been extensively studied in the context of generalization, training stability, and adversarial robustness.
arXiv AI
1d ago
Statistical Adversaries: Natural Backdoor-like Adversarial Features in Clean Vision Datasets
arXiv:2607. 05516v2 Announce Type: replace-cross Abstract: Model-specific adversarial attacks have been extensively studied.
arXiv AI
Jul 22
Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model
arXiv:2607. 18958v1 Announce Type: cross Abstract: While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks.
Hugging Face Trending Papers
Jul 21
Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model
While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks. Existing defense methods predominantly target single-task scenarios (e.
arXiv AI
Jul 8
Statistical Adversaries: Natural Backdoor-like Features in Vision Datasets
arXiv:2607. 05516v1 Announce Type: cross Abstract: Model-specific adversarial attacks have been extensively studied.
arXiv AI
Jun 24
PHANTOM: A Large-Scale Dataset of Multimodal Adversarial Attacks for Vision-Language Models
arXiv:2606. 24388v1 Announce Type: new Abstract: We introduce a large-scale, open-source dataset of pre-generated adversarial attacks for vision-language models (VLMs).
arXiv Machine Learning
Jul 21
Certified Training for Convolutional Perturbations
arXiv:2607. 18195v1 Announce Type: cross Abstract: Vision models have been found to be susceptible to perturbations such as motion blur induced at runtime by a shaking camera.