arXiv Machine Learning
Jun 4

Expert-Aware Refusal Steering

arXiv:2606. 04160v1 Announce Type: cross Abstract: Safety alignment in instruction-tuned large language models (LLMs) depends on a model's ability to reliably refuse to respond to harmful or disallowed requests.

By Anna C. Marbut, Daniel R. Olson, Travis J. Wheeler
arXiv Computation and Language
Sep 23

Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibratione

The paper addresses the problem of over‑refusal in safety‑aligned large language models, where benign instructions are incorrectly rejected. It identifies that a small set of hypersensitive safety heads in transformer attention misfire on hard‑safe prompts, causing abnormal attention entanglement and high‑entropy routing conflicts that block necessary attention to target entities. To mitigate this, the authors propose Semantic Routing Calibration (SRC), a lightweight, training‑free inference framework that dynamically suppresses these hypersensitive heads and fuses logits from dual branches to restore trustworthy reasoning while preserving intrinsic safety performance.

By Zixuan Wang, Bingjie Zhang, He Zhao, Dandan Guo
arXiv AI
Oct 2

Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibration

The paper addresses the problem of large language models (LLMs) over-refusing to comply with benign safety-related instructions. It identifies that a small number of hypersensitive safety heads in transformer attention misfire on hard-safe prompts, causing abnormal attention entanglement and high-entropy routing conflicts that lead to refusals. The authors propose Semantic Routing Calibration (SRC), a lightweight, training‑free inference framework that dynamically suppresses these problematic heads and fuses logits to restore trustworthy reasoning while preserving intrinsic safety performance.

By Zixuan Wang, Bingjie Zhang, He Zhao, Dandan Guo