arXiv AI
RefusalGuard: Geometry-Preserving Fine-Tuning for Safety in LLMs
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv Machine Learning
Jun 4
Few Tokens, Big Leverage: Preserving Safety Alignment by Constraining Safety Tokens during Fine-tuning
arXiv:2603. 07445v2 Announce Type: replace-cross Abstract: Large language models (LLMs) often require fine-tuning (FT) to perform well on downstream tasks, but FT can induce safety-alignment drift even when the training dataset contains only benign data.
arXiv Machine Learning
Jul 13
Optimizing Against Safety Representations: Activation-Guided Adversarial Suffixes and the Geometry of Refusal
arXiv:2607. 08883v1 Announce Type: new Abstract: Behavioral alignment in large language models often masks fragile internal safety representations.
arXiv Machine Learning
Jun 15
NeST: Neuron Selective Tuning for LLM Safety
arXiv:2602. 16835v2 Announce Type: replace-cross Abstract: Safety alignment is essential for the responsible deployment of Large Language Models (LLMs).
arXiv AI
Jun 18
Beyond Safe Data: Pretraining-Stage Alignment with Regular Safety Reflection
arXiv:2606. 19168v1 Announce Type: new Abstract: To achieve deeper safety alignment for large language models (LLMs), recent efforts have studied how to push safety interventions earlier into the pretraining stage, primarily by filtering unsafe data or rewriting it into safer forms.
arXiv AI
Jul 21
TRACE: Trajectory-Based Safety Patch Learning for LLM Post-Training Realignment
arXiv:2607. 16242v1 Announce Type: cross Abstract: Fine-Tuning-as-a-Service (FTaaS) platforms let users train large language models (LLMs) on customized tasks, but this pipeline could erode models' safety alignment.
arXiv Machine Learning
Jun 11
AsFT: Anchoring Safety During LLM Fine-Tuning Within Narrow Safety Basin
arXiv:2506. 08473v4 Announce Type: replace Abstract: Fine-tuning large language models (LLMs) improves performance but introduces critical safety vulnerabilities: even minimal harmful data can severely compromise safety measures.