arXiv Machine Learning By Alex Ferrando, Xavier Suau, Jordi Gonz\`alez, Pau Rodriguez

Dynamically Scaled Activation Steering

Read the original on arXiv Machine Learning →

arXiv:2512. 03661v2 Announce Type: replace Abstract: Activation steering has emerged as a powerful method for guiding the behavior of generative models towards desired outcomes such as toxicity mitigation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Oct 3

Kernelized Activation Steering

Kernelized Activation Steering (KAS) introduces a training‑free method for controlling attributes of generative models by lifting activation steering into a reproducing kernel Hilbert space. It formulates steering as an optimization problem using only kernel evaluations, producing an implicit, activation‑dependent steering score that adapts locally to the geometry of the activation space. Unlike standard Difference‑in‑Means, KAS generates a nonlinear steering field and recovers DiM as a special case with a linear kernel, achieving comparable or superior performance on tasks such as jailbreaking LLMs and image style control.

By Laziz U. Abdullaev, Minh-Hieu Pham, Bach Do, Khoat Than, Tan M. Nguyen
arXiv AI
Oct 1

Steering Fields: Adaptive Vector Fields for Safe Image Generation and Beyond

Steering Fields introduce adaptive vector fields that re-estimate steering directions at each step of a flow-based text-to-image generation process, replacing the fixed global steering vectors traditionally used. By operating on noisy states, they provide a continuous trade-off between steering strength and content preservation, and allow simultaneous induction and inhibition of concepts without explicit spatial masks or object priors. The method achieves state-of-the-art safety steering benchmarks and can also function as a structure-preserving image-editing technique, delivering high semantic fidelity while remaining model-agnostic and inversion-free.

By Simone Facchiano, Jan Eric Lenssen, Bernt Schiele, Wolfgang Stammer, Fabio Galasso, Jonas Fischer
arXiv AI
Jul 23

OPIUM: Mitigating Steering Externalities and Over-Refusal via Dual Objective Latent Optimization

arXiv:2607. 19806v1 Announce Type: cross Abstract: Activation steering provides a lightweight mechanism for controlling large language models at inference time, but steering vectors can have unintended externalities: utility vectors may weaken safety behavior, while refusal vectors may induce over-refusal on benign prompts.

By Kavin Aravindan, Arihant Rastogi, Aadi Prasad, Krishak Aneja, Saiyam Jain, Vaishnavi Shivkumar, Ponnurangam Kumaraguru