arXiv Machine Learning
Sep 10

Disentangling Steering Vectors

arXiv:2609.07037v1 Announce Type: new Abstract: Activation steering has emerged as a lightweight, inference-time approach to control the behavior of Large Language Models (LLMs). However, traditional...

By Takeru Hiramatsu, Kyohei Atarashi, Koh Takeuchi, Hisashi Kashima
arXiv Machine Learning
Jun 15

Towards Steering without Sacrifice: Principled Training of Steering Vectors for Prompt-only Interventions

arXiv:2605. 05983v2 Announce Type: replace Abstract: Recently, steering vectors (SVs) have emerged as an effective and lightweight approach to steer behaviors of large language models (LLMs), among which fine-tuned SVs are more effective than optimization-free ones.

By Yuntai Bao, Qinfeng Li, Xinyan Yu, Ge Su, Wenqi Zhang, Liu Yan, Haiqin Weng, Jianwei Yin, Xuhong Zhang
arXiv Machine Learning
Oct 16

Where to Steer: Input-Dependent Layer Selection for Steering Improves LLM Alignment

The paper introduces Where to Steer (W2S), a framework that adaptively selects which layer of a large language model to intervene on based on the input. It argues that optimal steering layers vary across inputs and demonstrates that W2S outperforms fixed-layer steering methods on several LLMs and alignment tasks, both in‑distribution and out‑of‑distribution. The study highlights input‑dependent layer selection as a complementary design dimension to steering vector extraction.

By Soham Gadgil, Chris Lin, Su-In Lee