arXiv Machine Learning

Representational Geometry as a Diagnostic for Adversarial Robustness

The paper investigates how adversarial training alters the internal representations of neural networks. Using Multilayer Perceptrons trained on MNIST under three different adversarial regimes, the authors embed training data with M-PHATE and analyze changes in geometry across epochs. They measure displacement, distributional distance, and nearest‑neighbor recovery on penultimate‑layer representations, finding that adversarial training induces structural changes that can rank defenses differently in terms of robust accuracy and representational stability.

arXiv Machine Learning
6d ago

Structured Confidence Perturbation via Fisher Geometry for Adversarial Training

The paper introduces two methods to improve adversarial training by targeting the model’s confidence structure. One method blends cross‑entropy with KL divergence to simultaneously degrade accuracy and distribution consistency, while the other uses Fisher geometry to generate perturbations that maximize distribution distance on the confidence manifold. Experiments show these techniques outperform existing approaches in robustness and transferability, especially for high‑confidence structural perturbations.

By Chenlong Wei, Hanling Wang, Chong Zhang, Qinkai Yu, Fangyu Wu, Xiaobo Jin
arXiv Machine Learning
Jun 26

Over-parameterization and Adversarial Robustness in Neural Networks: An Overview and Empirical Analysis

arXiv:2406. 10090v3 Announce Type: replace Abstract: Thanks to their extensive capacity, over-parameterized neural networks exhibit superior predictive capabilities and generalization.

By Srishti Gupta, Zhang Chen, Luca Demetrio, Fabio Brau, Xiaoyi Feng, Zhaoqiang Xia, Antonio Emanuele Cin\`a, Maura Pintor, Luca Oneto, Ambra Demontis, Battista Biggio, Fabio Roli