arXiv AI By Kyle Domico, Jean-Charles Noirot Ferrand, Ryan Sheatsley, Eric Pauley, Josiah Hanna, Patrick McDaniel

Adversarial Agents: Black-Box Evasion Attacks with Reinforcement Learning

Read the original on arXiv AI →

arXiv:2503. 01734v3 Announce Type: replace-cross Abstract: Attacks on machine learning models have been extensively studied through stateless optimization.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv Machine Learning
Sep 22

Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision

The paper introduces RIBA, a reinforcement‑learning inspired black‑box adversarial attack that generates perturbations for neural networks with fewer queries than existing methods. RIBA achieves a 25.4% reduction in median queries on ResNet‑18/Cifar10 and a 22.5% reduction on Vit‑B/16/ImageNet, while matching white‑box attack performance on an adversarially trained model.

By Florian Krone, Elena Hoemann, Sven Hallerbach
arXiv AI
Sep 2

SEBA: Sample-Efficient Black-Box Attacks on Visual Reinforcement Learning

SEBA is a sample‑efficient framework for black‑box adversarial attacks on visual reinforcement learning agents. It combines a shadow Q model, a generative adversarial network for imperceptible perturbations, and a world model to simulate dynamics, reducing real‑world queries. Experiments on MuJoCo and Atari show SEBA significantly lowers cumulative rewards while preserving visual fidelity and requiring far fewer environment interactions than previous methods.

By Tairan Huang, Yulin Jin, Junxu Liu, Qingqing Ye, Haibo Hu
Hugging Face Trending Papers
Jun 13

Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment

Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution. Existing defenses report near-zero attack success rate on static benchmarks, yet recent adaptive evaluations show that these results collapse once the attacker is allowed to optimize against the deployed defense.