arXiv AI
Jun 6
Adversarial Agents: Black-Box Evasion Attacks with Reinforcement Learning
arXiv:2503. 01734v3 Announce Type: replace-cross Abstract: Attacks on machine learning models have been extensively studied through stateless optimization.
Efficient Adversarial Attacks on High-dimensional Offline Bandits
arXiv:2602. 01658v2 Announce Type: replace-cross Abstract: Bandit algorithms have recently emerged as a powerful tool for evaluating machine learning models, including generative image models and large language models, by efficiently identifying top-performing candidates without exhaustive comparisons.
Related stories
arXiv AI
Aug 6
Stabilizing Multi-Attack Adversarial Training via Bandit Optimization
arXiv:2511. 12265v2 Announce Type: replace-cross Abstract: Deep Neural Networks (DNNs) remain vulnerable to diverse adversarial perturbations, motivating multi-attack adversarial training (AT) for improved robustness.
arXiv AI
Jun 11
Reinforcement Learning Disrupts Gradient-Based Adversarial Optimization
arXiv:2606. 12251v1 Announce Type: cross Abstract: Gradient-based adversarial attacks remain a dominant threat to deep neural networks (DNNs), as they exploit gradient information to efficiently optimize adversarial perturbations.
arXiv Machine Learning
Jun 26
Learning from Equivalence Queries, Revisited
arXiv:2604. 04535v2 Announce Type: replace Abstract: Modern machine learning systems, such as generative models and recommendation systems, often evolve through a cycle of deployment, user interaction, and periodic model updates.
arXiv Machine Learning
2d ago
Localization then Neutralization: Gradient-guided Token Suppression against Visual Prompt Injection Attack
arXiv:2605. 25194v2 Announce Type: replace Abstract: Adversarial images pose a severe security threat to multimodal large language models through prompt injection.
arXiv Machine Learning
Jul 7
Binary Iterative Method for Non-targeted Adversarial Attack
arXiv:2607. 04145v1 Announce Type: new Abstract: Adversarial attacks guide and provide additional training and test data for both adversarial training and adversarial robustness validation, and expose the 'piecewise linearity' of deep learning based models.
arXiv AI
Aug 3
Efficient LLM Adversarial Training via Low-Rank Defense and Circuit-Guided Surrogates
arXiv:2607. 28959v1 Announce Type: cross Abstract: Adversarial training is one of the most effective defenses against adversarial attacks, yet the computational cost remains prohibitive at modern scales, especially for large language models (LLMs).
Hugging Face Trending Papers
Jun 13
Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment
Indirect prompt injection attacks hijack LLM-based agents by embedding malicious instructions in third-party data that the agent retrieves during task execution. Existing defenses report near-zero attack success rate on static benchmarks, yet recent adaptive evaluations show that these results collapse once the attacker is allowed to optimize against the deployed defense.
arXiv Machine Learning
Jun 19
Adversarial Bandit Optimization with Globally Bounded Perturbations to Convex Losses
arXiv:2606. 19891v1 Announce Type: new Abstract: We study adversarial bandit optimization in which the loss functions may be non-convex and non-smooth.
arXiv AI
Jun 16
Policy Regret for Embedding Model Routing: Contextual Bandits with Low-Rank Experts
arXiv:2606. 14929v1 Announce Type: cross Abstract: Modern recommendation systems increasingly rely on dynamically routing diverse queries to multiple embedding models.
arXiv Machine Learning
Jun 9
Robust In-Context Reinforcement Learning Under Reward Poisoning Attacks
arXiv:2506. 06891v3 Announce Type: replace Abstract: We study the corruption-robustness of in-context reinforcement learning (ICRL), focusing on the Decision-Pretrained Transformer (DPT, Lee et al.
arXiv AI
Jul 13
Correlation-Aware Contextual Bandits with Surrogate Rewards for LLM Routing
arXiv:2607. 09015v1 Announce Type: cross Abstract: We study contextual bandit problems with correlated arms and access to surrogate reward signals produced by a machine learning model, motivated by applications such as large language model (LLM) routing.