arXiv AI

Beyond Boundaries: A Comprehensive Survey of Transferable Attacks on AI Systems

The paper surveys transferable attacks on AI systems, noting that such attacks can be crafted in one setting and then applied to others, thereby lowering costs and increasing security risks. It introduces a unified taxonomy across six axes—cross-instance, cross-domain, cross-modality, cross-model, cross-task, and cross-deployment—while distinguishing source-target changes from attacker resources. The survey also links transfer mechanisms to enhancement methods, highlights inconsistencies and gaps in current research, and proposes a research agenda for better benchmarking and defense strategies.

arXiv AI
Jun 3

AI Model Extraction Attacks: Bypassing Single-Client Assumptions in Defenses

arXiv:2606. 03381v1 Announce Type: cross Abstract: Ensuring the protection of Artificial Intelligence (AI) models deployed in military Command and Control (C2) systems and critical infrastructure is essential for maintaining information superiority.

By Maxime Schwarzer, Johannes F. Loevenich, Gustavo S\'anchez, Laurin Holz, Thies M\"ohlenhof, Tobias H\"urten, Roberto Rigolin F. Lopes, Veit Hagenmeyer
arXiv AI
Jun 2

Catch-Only-One: Non-Transferable Examples for Model-Specific Authorization

arXiv:2510. 10982v2 Announce Type: replace-cross Abstract: Recent AI regulations increasingly emphasize the need for mechanisms that preserve the utility of data for AI innovation while preventing misuse, particularly by enforcing purpose limitation in downstream AI applications.

By Zihan Wang, Zhiyong Ma, Zhongkui Ma, Shuofeng Liu, Akide Liu, Derui Wang, Minhui Xue, Guangdong Bai
arXiv AI
Jun 12

The Emergence of Autonomous Penetration Capabilities in Large Language Model-Powered AI Systems

arXiv:2606. 13079v1 Announce Type: cross Abstract: Nowadays, the autonomous execution of cyberattacks capable of causing substantial real-world harm is widely regarded as one of the critical red lines that frontier AI systems must not cross.

By Jiaqi Luo, Jiarun Dai, Zhile Chen, Jia Xu, Weibing Wang, Yawen Duan, Brian Tse, Geng Hong, Xudong Pan, Yuan Zhang, Min Yang
arXiv Computer Vision
Oct 2

A Comprehensive Review of One-Pixel Attack: Research Status, Taxonomy, Applications, Regulation Policy and Future Directions

The paper reviews one‑pixel attacks (OPAs), highlighting their extreme adversarial fragility across domains such as medical diagnosis, autonomous driving, biometrics, and quantum communication. It presents a PRISMA‑guided synthesis of studies from 2017 to 2026, offering a unified taxonomy that covers algorithmic foundations, black‑box evolutionary optimization, hybrid and program‑synthesis attacks, defence mechanisms, interpretability tools, and domain‑specific vulnerabilities. The review identifies dominant Differential Evolution strategies, emerging efficiency‑optimized and saliency‑guided methods, and gaps in dataset diversity, transferability, and evaluation standards, while proposing future research directions and a regulatory framework for robustness testing and AI security governance.

By Mirza Niaz Morshed, Md. Masudul Islam, Galib Muhammad Shahriar Himel, Md. Aslam Uddin, Hui Liu, Md. Shafiqul Islam
arXiv Machine Learning
Sep 29

Frame the adversary: a structure-aware attack methodology

The paper introduces a new framework for creating frequency‑based adversarial attacks that are grounded in an explicit optimization problem. By defining a perturbation constraint set linked to structured, non‑orthogonal transforms, the authors show that attacks can be generated as weighted σ‒projections onto this set, providing a clear geometric characterization. Experiments on standard datasets demonstrate that these attacks are highly effective across both pretrained and robust models, even on unseen architectures.

By Vicky Kouni, Stelios Perrakis, Francis Bach, Pascal Frossard, Yann Chevaleyre