arXiv Computation and Language
TraceRouter++: Causal Semantic Routing Realignment via Optimal Transport
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
Related stories
arXiv AI
Sep 3
SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment
The paper introduces SEAL, a training-time, parameter‑efficient defense that attaches a plug‑and‑play adapter to the shared expert component of Mixture‑of‑Experts models, and SEAL++, which adds an orthogonal constraint to preserve existing safety subspaces. By leveraging the always‑activated shared expert, SEAL mitigates the structural vulnerability of sparse routing to adversarial manipulation, reducing attack success rates by up to 60% with minimal impact on model capability. The approach is evaluated across six attack scenarios involving harmful prompting, jailbreaks, malicious fine‑tuning, and neuron pruning.
arXiv AI
Sep 2
From Detection to Refusal: Safer LLMs via Circuit-Guided Weight Scaling
arXiv:2609.00051v1 Announce Type: cross Abstract: Despite extensive alignment efforts, Large Language Models (LLMs) remain vulnerable to generating unsafe content under adversarial prompting, yet the...
arXiv Machine Learning
Jul 31
Beyond the Bidirectional Promise: Re-evaluating the Robustness of Diffusion Language Models
arXiv:2607. 27386v1 Announce Type: cross Abstract: Diffusion Language Models (DLMs) offer a compelling alternative to autoregressive (AR) generation by enabling bidirectional context and iterative refinement.
arXiv AI
Oct 2
Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibration
The paper addresses the problem of large language models (LLMs) over-refusing to comply with benign safety-related instructions. It identifies that a small number of hypersensitive safety heads in transformer attention misfire on hard-safe prompts, causing abnormal attention entanglement and high-entropy routing conflicts that lead to refusals. The authors propose Semantic Routing Calibration (SRC), a lightweight, training‑free inference framework that dynamically suppresses these problematic heads and fuses logits to restore trustworthy reasoning while preserving intrinsic safety performance.
arXiv Computation and Language
Sep 23
Mitigating LLM Over-Refusal via Dynamic Semantic Routing Calibratione
The paper addresses the problem of over‑refusal in safety‑aligned large language models, where benign instructions are incorrectly rejected. It identifies that a small set of hypersensitive safety heads in transformer attention misfire on hard‑safe prompts, causing abnormal attention entanglement and high‑entropy routing conflicts that block necessary attention to target entities. To mitigate this, the authors propose Semantic Routing Calibration (SRC), a lightweight, training‑free inference framework that dynamically suppresses these hypersensitive heads and fuses logits from dual branches to restore trustworthy reasoning while preserving intrinsic safety performance.
arXiv Machine Learning
Jul 13
Optimizing Against Safety Representations: Activation-Guided Adversarial Suffixes and the Geometry of Refusal
arXiv:2607. 08883v1 Announce Type: new Abstract: Behavioral alignment in large language models often masks fragile internal safety representations.