arXiv Machine Learning

Fast Adversarial Attacks with Gradient Prediction

The paper introduces a new class of adversarial attacks that eliminate the need for a backward pass by predicting input gradients from forward-pass hidden states using lightweight linear regression. The authors theoretically derive exact affine conditional gradient means, proving optimality in the idealized NTK regime, and empirically demonstrate that their methods recover most of FGSM’s performance while achieving a 532% increase in throughput on practical finite-width models. This approach offers a simple and general way to generate adversarial examples much faster under realistic wall‑clock constraints.

arXiv Machine Learning
Oct 23

MIG-COW: Transferable Adversarial Attacks on Deepfake Detectors via Gradient Decomposition

MIG‑COW is a new adversarial attack framework that uses momentum‑integrated gradients and a consensus‑orthogonal decomposition to create highly generalizable, visually imperceptible perturbations against deepfake detectors. It achieves a 99.96% white‑box attack success rate on the AADD‑2025 Challenge benchmarks while maintaining high perceptual similarity (SSIM). In black‑box settings, its success rate drops to 7.16%, and adding low‑performing but diverse models to the ensemble can reduce attack effectiveness, highlighting the importance of careful surrogate model selection.

By Wonjune Seo, Joonhyuk Baek, Yeseong Jung, Saerom Park
arXiv Machine Learning
Oct 16

Locking Pretrained Weights via Deep Low-Rank Residual Distillation

The paper introduces DLR-Lock, a defense that replaces each pretrained MLP in a language model with a deep low‑rank residual network (DLR‑Net). This substitution increases activation memory linearly with depth during backpropagation and creates architectural mismatches that hinder fine‑tuning. Experiments on large language models show that DLR‑Lock can withstand adaptive attackers while preserving the model’s original performance.

By Keitaro Sakamoto, Pierre Ablin, Federico Danieli, Marco Cuturi
arXiv AI
Sep 24

When Clients Are Orchestrated: Strategic Gradient Manipulation to Defeat Federated Learning Servers with Efficient Defense

The paper introduces Fed-ADR, a coordinated attack framework where a malicious orchestrator server directs heterogeneous adversarial clients to adapt their gradient updates in real time, thereby evading existing federated learning defenses and drastically reducing global model accuracy. It also presents a lightweight detection mechanism that estimates true client gradients from historical data to spot coordinated attacks, and an in-situ recovery method that restores model performance without restarting training. Experiments on MNIST, Fashion‑MNIST, and CIFAR‑10 show the attack can drop accuracy from over 90% to below 10%, while the defense can recover accuracy to above 90% within a few rounds at a computational cost at least 20× lower than retraining from scratch.

By Mohamed Shaaban, Ahmed Abdelnaby, Mohamed Elmahallawy
arXiv AI
Jul 9

NonTextual Target Attack

arXiv:2510. 02999v5 Announce Type: replace-cross Abstract: Existing gradient-based jailbreak attacks on Large Language Models (LLMs) typically optimize adversarial suffixes to align the LLM output with predefined target responses.

By Xinzhe Huang, Wenjing Hu, Tianhang Zheng, Kedong Xiu, Hongsheng Hu, Xiaojun Jia, Di Wang, Zhan Qin, Kui Ren