arXiv AI
SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editing
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Sep 22
StyleAT: Defending Face Recognition Against Semantic Attacks
arXiv:2609.23596v1 Announce Type: cross Abstract: With face-recognition models now embedded in everyday authentication and surveillance, recent works have pinpointed a critical weakness: these models...
Hugging Face Trending Papers
Aug 19
Breaking the weakest link to evade vision language models
The paper investigates how Vision Language Models (VLMs) can be fooled by tiny, human‑imperceptible changes to images. It introduces a gradient‑based attack that targets only the vision encoder, reducing computational cost while still effectively disrupting both untargeted and targeted multimodal interpretations. Experiments on open‑source VLMs such as Qwen2.5‑VL, Granite‑Vision, FastVLM, and Phi‑3.5‑Vision demonstrate that these small perturbations can dramatically alter the models’ textual outputs.
arXiv AI
Aug 20
Breaking the weakest link to evade vision language models
The paper investigates how Vision Language Models (VLMs) can be fooled by small, human‑imperceptible changes to images. It introduces a gradient‑based attack that targets only the vision encoder, reducing computational cost while still effectively disrupting both untargeted and targeted multimodal alignment. Experiments on open‑source VLMs such as Qwen2.5‑VL, Granite‑Vision, FastVLM, and Phi‑3.5‑Vision demonstrate that these perturbations can significantly alter the models’ textual outputs.
arXiv Machine Learning
Oct 28
Attack logics, not outputs: Concept-based Property Attacks for Shortcut Elimination in Neural Networks
The paper introduces concept-based property attacks, which target logical inconsistencies in human‑interpretable concepts (e.g., “red ∧ octagonal → stop_sign”) rather than merely flipping final class labels. It formalizes these properties, proves that attacking them reduces the search space compared to class‑level attacks, and implements them using concept‑based explainable AI techniques. Empirical results across vision and code‑processing models show that retraining with these attacks preserves robustness gains while better eliminating semantic biases.
Hugging Face Trending Papers
Jul 21
Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model
While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks. Existing defense methods predominantly target single-task scenarios (e.
arXiv AI
Jul 22
Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model
arXiv:2607. 18958v1 Announce Type: cross Abstract: While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks, posing significant security risks.