arXiv Computation and Language

Groundhog Bit-Flip Attack: Seeding Infinite Generation Loops in Mixture-of-Experts LLMs through Bit Flips

The paper introduces the Groundhog Bit-Flip Attack (GBFA), a novel denial-of-service attack targeting Mixture-of-Experts (MoE) large language models (LLMs). By flipping specific routing-layer bits that activate certain experts, GBFA can cause models to generate excessively long outputs—up to a 5912% increase in token usage—while largely preserving semantic content. The attack requires deactivating fewer than four experts on average across four real-world MoE-based LLMs, exposing a significant robustness vulnerability in these architectures.

arXiv Machine Learning
5d ago

Characterizing Recoverable Expert-Utilization Signatures in Fine-Tuned Mixture-of-Experts LLMs

The paper investigates a new security vulnerability in fine‑tuned Mixture‑of‑Experts large language models, termed structural memorization, where the model not only memorizes training data but also the internal routing pathways used during fine‑tuning. The authors demonstrate that these memorized expert pathways can be recovered from the model’s unconditional generation using only routing and output logits, even without access to the fine‑tuning data. They further show that this vulnerability is amplified in distributed deployments and that traditional membership inference metrics fail to detect it, proposing composite metrics that improve detection of memorized routing structures.

By Fei Wang, Baochun Li, Bo Li
arXiv AI
Oct 15

ProtoArena: Can AI Agents Discover and Exploit Real-World Cross-Component Protocol Vulnerabilities?

ProtoArena is a new black-box benchmark that tests AI agents on 80 cross‑component vulnerability‑exploitation environments across 11 protocol and application domains and 7 attack categories. It evaluates agents at three information levels—guided reproduction, exploitation with context, and effect‑directed black‑box exploration—using a hybrid verifier that combines rule‑based checks with LLM review of traffic and logs. In experiments, Claude Opus 4.8 achieved the highest success rates, reaching 48.8% under guided conditions and 12.5% in effect‑directed black‑box scenarios, while also demonstrating significant DNSBomb optimization performance.

By Fasheng Miao, Zhaoyu Hu, Xiang Li, Changqing An, Jiutian Zeng, Longtao Huang, Haixin Duan, Jilong Wang
arXiv AI
Sep 3

SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment

The paper introduces SEAL, a training-time, parameter‑efficient defense that attaches a plug‑and‑play adapter to the shared expert component of Mixture‑of‑Experts models, and SEAL++, which adds an orthogonal constraint to preserve existing safety subspaces. By leveraging the always‑activated shared expert, SEAL mitigates the structural vulnerability of sparse routing to adversarial manipulation, reducing attack success rates by up to 60% with minimal impact on model capability. The approach is evaluated across six attack scenarios involving harmful prompting, jailbreaks, malicious fine‑tuning, and neuron pruning.

By Qingyu Meng, Yiwei Zha, Jiahuan Pei, Koen Hindriks, Herbert Bos, Min Chen
arXiv AI
Oct 9

Speedbumps: Rejection Attacks on Speculative Decoding

Speedbumps: Rejection Attacks on Speculative Decoding explores how Speculative Rejection Attacks (SRAs) can degrade the efficiency of speculative decoding by causing draft and target models to disagree more often, leading to more target-model forward passes per token. The authors introduce two attacks—Speedbump-P and Speedbump-D—that append adversarial suffixes to attacker-controlled content, optimizing the expected length of the accepted speculative prefix. In some scenarios, these attacks slow inference below autoregressive decoding, reduce output quality, yet remain effective under sampling and transfer across drafters or target models sharing a drafter.

By Adam Y. J. Jones, Yu Yuan, Sergio Maffeis
arXiv AI
Aug 18

SysEvolve: An AI-native, safe, autonomous adversarial attack-defense co-evolutionary system

arXiv:2608. 15012v1 Announce Type: cross Abstract: The rapid advancement of large language models (LLMs) has created a growing asymmetry in cybersecurity, where attack accelerates toward autonomous execution while defense remains predominantly human-intensive.

By Yuhan Meng, Shaofei Li, Jionghao Huang, Jiandong Jin, Puyi Wang, Hanlin Jiang, Anis Yusof, Peng Jiang, Zhenkai Liang, Yao Guo, Ding Li