arXiv AI
Jun 6
Adversarial Agents: Black-Box Evasion Attacks with Reinforcement Learning
arXiv:2503. 01734v3 Announce Type: replace-cross Abstract: Attacks on machine learning models have been extensively studied through stateless optimization.
Reinforcement Learning Disrupts Gradient-Based Adversarial Optimization
arXiv:2606. 12251v1 Announce Type: cross Abstract: Gradient-based adversarial attacks remain a dominant threat to deep neural networks (DNNs), as they exploit gradient information to efficiently optimize adversarial perturbations.
Related stories
arXiv Machine Learning
Sep 22
Reinforcement Learning Inspired Black-box Adversarial Attacks for Computer Vision
The paper introduces RIBA, a reinforcement‑learning inspired black‑box adversarial attack that generates perturbations for neural networks with fewer queries than existing methods. RIBA achieves a 25.4% reduction in median queries on ResNet‑18/Cifar10 and a 22.5% reduction on Vit‑B/16/ImageNet, while matching white‑box attack performance on an adversarially trained model.
arXiv Computer Vision
3d ago
Opportunistic Target Selection: Early Directional Commitment for Query-Efficient Black-Box Adversarial Attacks
arXiv:2605.25663v2 Announce Type: replace-cross Abstract: Black-box adversarial attacks that minimize only the ground-truth confidence suffer from class drift: perturbations wander through the featur...
arXiv Machine Learning
Jul 7
Binary Iterative Method for Non-targeted Adversarial Attack
arXiv:2607. 04145v1 Announce Type: new Abstract: Adversarial attacks guide and provide additional training and test data for both adversarial training and adversarial robustness validation, and expose the 'piecewise linearity' of deep learning based models.
arXiv Machine Learning
Aug 4
DeepDefense: Robust Learning via Layer-Wise Gradient-Feature Alignment
arXiv:2511. 13749v2 Announce Type: replace Abstract: Deep neural networks are known to be vulnerable to adversarial perturbations, which are small, carefully crafted inputs that lead to incorrect predictions.
arXiv Machine Learning
Sep 10
WMAttack: Automated Attack Search for Adversarial Evaluation of World-Model Agents
arXiv:2605.23220v2 Announce Type: replace Abstract: Despite the growing use of world models as decision-making agents, their adversarial robustness remains underexplored due to the lack of dedicated...
arXiv Machine Learning
Sep 14
Robust Policy Optimization via Adversarial Importance Sampling
The paper introduces Adversarial Importance Sampling (Advis), a technique that leverages importance sampling over standard training trajectories to estimate and optimize worst‑case returns without extra environment interactions or auxiliary networks, thereby capturing long‑term robustness. It also presents advrl, a modular PyTorch library that consolidates existing robustness methods and adversarial attacks into single‑file implementations for easier prototyping and reproducible evaluation. Finally, the authors highlight that optimal adversarial hyperparameters do not transfer across agents, prompting evaluation against a broader set of attackers (6–14× more configurations) and demonstrate the effectiveness of their approach on continuous control tasks.
Hugging Face Trending Papers
Jun 13
Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution. Existing defenses report near-zero attack success rate on static benchmarks, yet recent adaptive evaluations show that these results collapse once the attacker is allowed to optimize against the deployed defense.
arXiv AI
Jun 16
Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
arXiv:2606. 15441v1 Announce Type: cross Abstract: Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution.
arXiv AI
Jun 2
Boosting RL-Based Visual Reasoning with Selective Adversarial Entropy Intervention
arXiv:2512. 10414v2 Announce Type: replace Abstract: Recently, reinforcement learning (RL) has become a common choice in enhancing the reasoning capabilities of vision-language models (VLMs).
arXiv AI
Jul 17
Random Logit Scaling: Defending Deep Neural Networks Against Black-Box Score-Based Adversarial Example Attacks
arXiv:2607. 14921v1 Announce Type: cross Abstract: Machine learning models are increasingly adapted in various domains.
arXiv Machine Learning
Sep 1
RL-FAT: Reinforcement Learning for Fair Adversarial Training
arXiv:2608.29247v1 Announce Type: new Abstract: Deep neural networks remain highly vulnerable to adversarial perturbations, and adversarial training (AT) has become a widely used approach for improvi...