Hugging Face Trending Papers
Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
Related stories
arXiv AI
Aug 25
Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty
arXiv:2608.23497v1 Announce Type: new Abstract: Reasoning-Induced Misalignment, where fine-tuning on reasoning data containing no harmful content, including mathematics, code, and problem-solving wit...
arXiv AI
Aug 24
RefusalGuard: Geometry-Preserving Fine-Tuning for Safety in LLMs
arXiv:2605.01913v2 Announce Type: replace-cross Abstract: Fine-tuning safety-aligned language models for downstream tasks often leads to substantial degradation of refusal behavior, making models vul...
arXiv AI
Sep 15
Beyond Safe Answers: Segment-Aware Listwise Alignment for Reasoning Safety in Large Reasoning Models
The paper introduces SaLT-DPO, a Segment‑aware Listwise Target DPO method designed to improve safety in Large Reasoning Models (LRMs). It decomposes responses into reasoning and answer segments, scores each segment’s safety, and aligns length‑normalized rewards with soft target distributions over multiple candidates. The approach also incorporates joint safety coherence regularization and utility anchoring to reduce unsafe content while maintaining compliance and reasoning performance.
arXiv AI
Jul 21
TRACE: Trajectory-Based Safety Patch Learning for LLM Post-Training Realignment
arXiv:2607. 16242v1 Announce Type: cross Abstract: Fine-Tuning-as-a-Service (FTaaS) platforms let users train large language models (LLMs) on customized tasks, but this pipeline could erode models' safety alignment.
arXiv AI
Aug 5
Risky Business: Measuring The Faithfulness-Safety Tension
arXiv:2608. 03745v1 Announce Type: new Abstract: Chain-of-Thought (CoT) reasoning offers a promising window into model monitoring.
arXiv AI
Sep 1
Integrated and Cross-Architecture Interpretation of LLM Reasoning
arXiv:2605.28006v2 Announce Type: replace-cross Abstract: Understanding how LLMs reason is hindered by a practical asymmetry: while their generated outputs are observable, the underlying reasoning pa...