arXiv:2607. 22570v1 Announce Type: new Abstract: Auditing a new language model usually means relearning and reinterpreting its internal features from scratch.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.
arXiv:2604. 03532v2 Announce Type: replace-cross Abstract: Large language models (LLMs) show strong multilingual capabilities, yet reliably controlling the language of their outputs remains difficult.
The paper introduces a controlled auditing framework using parametric CAD to separate failures in encoding, expression, and activation-level control in frozen large language models (LLMs). Applied to eight pretrained models and random controls, it finds that pretraining mainly improves linear decoding of local relations, while global constraint status is already highly decodable from random representations. Despite strong local decodability, the models’ zero‑shot predictions lag far behind supervised probe performance, and simple activation steering fails to provide reliable control; however, low‑rank fine‑tuning with only 400 labeled relation pairs can substantially improve generation on three models, indicating that the representation–behavior gap can be narrowed through adaptation.
arXiv:2606. 26620v1 Announce Type: cross Abstract: Sparse autoencoders (SAEs) have emerged as a powerful tool for decomposing superposed language model representations into sparse and interpretable features.
arXiv:2606. 11722v1 Announce Type: cross Abstract: Finding interpretable directions in language-model representations is critical for understanding and controlling model behavior.
arXiv:2606. 01695v1 Announce Type: new Abstract: Adversaries can implant latent harmful behavior by poisoning as few as 1% of fine-tuning examples.
arXiv:2609.15064v1 Announce Type: new Abstract: Reinforcement learning (RL) is widely utilized in large language model training to improve targeted capabilities, yet how RL reshapes a model remains p...