arXiv Machine Learning August 27, 2026 By Xu Zhang, Ren Wang

Robust CurveMoE: Multi-Norm Adversarial Defense for Mixture-of-Experts Models via Mode Connectivity

Read the original on arXiv Machine Learning →

Robust CurveMoE is a mixture‑of‑experts framework that protects neural networks against perturbations defined by multiple norm constraints. It connects norm‑specialized models through a low‑loss path, selectively expertises only influential layers, and shares the rest of the parameters across routing paths. The method introduces contribution‑guided partial updating to reduce curve‑construction cost and provides a theoretical bound on the objective gap between partial and full optimization, achieving consistent improvements in clean, norm‑specific, and Union accuracy on CIFAR‑100 and ImageNet‑100.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

Hugging Face Trending Papers

Aug 26

Robust CurveMoE: Multi-Norm Adversarial Defense for Mixture-of-Experts Models via Mode Connectivity

Multi-norm adversarial defense aims to protect neural networks against perturbations defined by different norm constraints, but existing methods typically optimize competing robustness objectives with...

llms computer-vision safety

arXiv Machine Learning

Sep 17

SAM-on-the-Curve: Sharpness-Aware Mode Connectivity for Robust Weight-Space Interpolation

The paper introduces Sharp Mode Connectivity (SMC), a new formulation of mode connectivity that optimizes for flatness in the entire local neighborhood of a weight-space path rather than just along the path itself. By applying a sharpness-aware approximation to a minimax objective, SMC produces low-loss curves that remain robust to distribution shifts, achieving significant accuracy gains on CIFAR‑10‑C and outperforming standard mode connectivity on several architectures.

By Alejandro Calatrava, Xu Zhang, Ren Wang

arXiv Machine Learning

Oct 7

Improving Mixup Calibration with Wasserstein Distributionally Robust Optimization

arXiv:2506.17874v3 Announce Type: replace-cross Abstract: In many real-world applications, ensuring the robustness and stability of deep neural networks (DNNs) is crucial, particularly for image clas...

By Jiaming Hu, Yeping Jin, Debarghya Mukherjee, Ioannis Ch. Paschalidis

computer-vision benchmarks

arXiv AI

Jul 1

Improving Certified Robustness via Adversarial Distillation

arXiv:2606. 31653v1 Announce Type: cross Abstract: Certified training aims to produce models whose predictions can be formally verified against adversarial perturbations, typically by optimising upper bounds on the worst-case loss over an allowed perturbation set.

By Matteo Melis, Jesus Martinez Del Rincon, Vishal Sharma

efficiency benchmarks safety

arXiv AI

Jul 8

RoME: Robust Mixture of Low-Rank Experts against Multiple Adversarial Perturbations

arXiv:2607. 06109v1 Announce Type: cross Abstract: Multi-perturbation adversarial training (MAT) aims to achieve robustness against multiple $\ell_p$ perturbations but suffers from robustness trade-offs between different threats.

By Woo Jae Kim, Kyle Min, Suhyeon Ha, Joonsung Jeon, Sung-eui Yoon

benchmarks safety

arXiv Machine Learning

Jul 7

Binary Iterative Method for Non-targeted Adversarial Attack

arXiv:2607. 04145v1 Announce Type: new Abstract: Adversarial attacks guide and provide additional training and test data for both adversarial training and adversarial robustness validation, and expose the 'piecewise linearity' of deep learning based models.

By Naman Goyal, Milan Chaudhari

safety

One email a morning, machine-written

Related stories

Robust CurveMoE: Multi-Norm Adversarial Defense for Mixture-of-Experts Models via Mode Connectivity

SAM-on-the-Curve: Sharpness-Aware Mode Connectivity for Robust Weight-Space Interpolation

Improving Mixup Calibration with Wasserstein Distributionally Robust Optimization

Improving Certified Robustness via Adversarial Distillation

RoME: Robust Mixture of Low-Rank Experts against Multiple Adversarial Perturbations

Binary Iterative Method for Non-targeted Adversarial Attack