Cross-Model In-Context Neurofeedback Reveals (Limited) Activation Control in LLMs
Read the original on Hugging Face Trending Papers →The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
The Flow has not summarised this story yet — read it at Hugging Face Trending Papers.
arXiv:2610.20179v1 Announce Type: cross Abstract: Probes on activation vectors are widely used to detect misbehavior in language models, but their success relies on the assumption that models cannot...
arXiv:2607. 25907v1 Announce Type: cross Abstract: Activation steering controls model behavior by editing internal activations at inference time.
arXiv:2605.30381v2 Announce Type: replace-cross Abstract: When a language model is fine-tuned to produce systematically incorrect responses, does this training leave a structured, linearly recoverabl...
The study investigates how task context reshapes the roles of shared attention heads in large language models. By applying identical graph facts and measuring interventions on attention heads and downstream activations, the authors show that task changes redistribute influence across five open‑weight models, causing the same heads to respond to different facts and affect later components differently. Linear response maps before and after activation edits reveal significant reductions in prediction error, indicating that task context alters both the facts processed and the downstream impact of shared components.
arXiv:2607. 03598v1 Announce Type: cross Abstract: When a person shares something with a language model, the model often answers the surface of the message rather than what the sender was doing by sending it: share a finished project and it critiques the code; share a raw late-night line and it runs a wellness check.
arXiv:2608.21664v1 Announce Type: new Abstract: Safe deployment of increasingly capable models will likely come to rely on latent-space monitoring as a complement to behavioral evaluations, especiall...