arXiv AI
Sep 3

InfraPatch: Cross-Task Targeted Grayscale Patch Attacks on Infrared-Adapted Vision-Language Models

InfraPatch is a white‑box, per‑instance framework that generates small grayscale patches to target infrared‑adapted vision‑language models (IR‑VLMs). The method optimizes a single‑channel patch within a 5% local‑area budget, using proxy‑guided placement and task‑adaptive objectives to induce desired behaviors in image classification, captioning, and binary visual question answering. Across ten IR‑VLM variants tested on synthetic infrared images, InfraPatch achieves targeted attack success rates ranging from 86% to 100%, revealing significant vulnerability differences among architectures and tasks.

By Chengyin Hu, Dingyi Lu, Jiaju Han, Xiang Chen, Weiwen Shi, Jiahuan Long, Yiwei Wei, Jiujiang Guo
arXiv Machine Learning
Oct 22

A Unified Evaluation Framework of Physical Adversarial Robustness in the Edge VLM Era

The paper introduces a unified evaluation framework for assessing the physical adversarial robustness of Vision‑Language Models (VLMs) deployed at the edge. It defines a conditional attack success rate (cASR) metric that counts only images where the model still localizes objects under a gray occluder, and categorizes failures into omission, substitution, and displacement. Benchmarking shows that compact grounding VLMs can be as vulnerable as traditional object detectors, with omission being the only failure visible to downstream systems, while displacement and substitution pose potentially more dangerous risks, especially under distribution shift.

By Eric Liang, Alan Luo, Kaiwen Yuan
arXiv AI
Jul 8

AirflowAttack: Thermal-Airflow Adversarial Perturbations against Infrared Remote-Sensing Vision-Language Models

arXiv:2607. 06485v1 Announce Type: cross Abstract: Vision-language models (VLMs) are increasingly deployed on infrared (IR) remote sensing imagery in security-critical settings, yet their adversarial robustness remains unexamined.

By Cong Su, Jiaju Han, Xuemeng Sun, Chengyin Hu, Qike Zhang, Jiujiang Guo, Yiwei Wei, Jiahuan Long
Hugging Face Trending Papers
Jul 7

AirflowAttack: Thermal-Airflow Adversarial Perturbations against Infrared Remote-Sensing Vision-Language Models

Vision-language models (VLMs) are increasingly deployed on infrared (IR) remote sensing imagery in security-critical settings, yet their adversarial robustness remains unexamined. We present AirflowAttack, to our knowledge the first adversarial attack for IR remote-sensing VLMs and the first to weaponize thermal-airflow turbulence as the perturbation prior.