arXiv Machine Learning By Yi Wang, Xiuyuan Qi, Dongqi Han, Dongsheng Li, Wenjie Wang

Safe at One Loop, Risky at Another: Aligning Safety Across Recurrent Depths in Looped Language Models

Read the original on arXiv Machine Learning →

The paper evaluates the safety of LoopLMs—parameter‑efficient language models that reuse shared parameters across recurrent steps—under jailbreak attacks at various depths. It finds that deeper inference can increase attack success, that safety responses vary across depths, and that attacks transfer between depths, even after standard alignment techniques. To address these gaps, the authors propose SafeBridge, a method that applies depth‑specific control, selective state bridging, and joint safety supervision, which markedly reduces attack success and improves overall utility without increasing over‑refusal.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 28

A Single Suffix to Break Them All: Basin-Aware Jailbreaks for Merged Model Families

The paper investigates safety risks in model merging, showing that even when all constituent models are individually safety‑aligned, merging can expose a jailbreak vulnerability rooted in the pretrained foundation model. It introduces Basin‑Aware Jailbreak (BAJ), a min–max optimization method that generates adversarial suffixes transferable across merged models sharing the same backbone, without needing the exact merging coefficients or checkpoints. Experiments demonstrate BAJ’s high transfer success rates across diverse backbones and merging settings, and its resilience against existing defenses.

By Yu Zhe, Yixin Tan, Junhao Wei, Wang Chen