arXiv Machine Learning

Structured Confidence Perturbation via Fisher Geometry for Adversarial Training

The paper introduces two methods to improve adversarial training by targeting the model’s confidence structure. One method blends cross‑entropy with KL divergence to simultaneously degrade accuracy and distribution consistency, while the other uses Fisher geometry to generate perturbations that maximize distribution distance on the confidence manifold. Experiments show these techniques outperform existing approaches in robustness and transferability, especially for high‑confidence structural perturbations.

arXiv AI
Sep 18

Information-Geometric Inverse Distillation for Enhancing Adversarial Transferability

The paper introduces Inverse Knowledge Distillation (IKD), an attack‑agnostic technique that enhances adversarial transferability by maximizing the discrepancy between benign and adversarial prediction distributions on a surrogate model. IKD employs a CE/KL‑equivalent soft‑label objective to push adversarial predictions away from a fixed benign anchor, leveraging Fisher‑sensitive surrogate directions. The authors provide theoretical analysis showing CE and KL induce identical gradients, derive a lower bound on Fisher‑subspace overlap, and demonstrate through extensive ImageNet experiments that IKD consistently improves black‑box attack performance across CNN, ViT, and defended models.

By Wenyuan Wu, Yuan Sun, Yingke Chen, Chao Su, Xi Peng, Dezhong Peng, Xu Wang
arXiv Machine Learning
1d ago

Representational Geometry as a Diagnostic for Adversarial Robustness

The paper investigates how adversarial training alters the internal representations of neural networks. Using Multilayer Perceptrons trained on MNIST under three different adversarial regimes, the authors embed training data with M-PHATE and analyze changes in geometry across epochs. They measure displacement, distributional distance, and nearest‑neighbor recovery on penultimate‑layer representations, finding that adversarial training induces structural changes that can rank defenses differently in terms of robust accuracy and representational stability.

By Brandon Ismalej, Alex Cloninger, Gal Mishne
Hugging Face Trending Papers
Aug 10

Confusion-Geometry Rebalancing for Long-Tailed Adversarial Training

Adversarial training under long tailed distributions suffers from a dual imbalance: the class imbalance skews the training objective toward head classes, and the adversarial inner maximization may further amplify this bias. Existing methods mitigate this issue by correcting class priors or adapting class wise robust supervision, yet they treat each class in isolation and fail to identify which boundaries drive long tailed collapse.

arXiv Computer Vision
Oct 9

Boosting the Local Invariance for Better Adversarial Transferability

The paper introduces LI-Boost, a technique that enhances the local invariance of adversarial perturbations to improve their transferability across models. By demonstrating a positive correlation between local invariance and transferability, the authors show that LI-Boost significantly boosts five categories of transfer-based attacks on ImageNet, including CNNs, ViTs, defense mechanisms, commercial APIs, and vision-language models. Extensive experiments confirm the method’s effectiveness across diverse architectures and attack types.

By Bohan Liu, Xiaosen Wang