arXiv:2602. 04718v2 Announce Type: replace-cross Abstract: A central premise in mechanistic interpretability is that meaningful concepts in language models are represented by linear features in activation space.
By Moritz Miller, Florent Draye, Bernhard Sch\"olkopf
arXiv:2608. 10537v1 Announce Type: new Abstract: Sparse autoencoders (SAEs) have helped uncover mechanistic explanations for LLM behaviours such as reasoning, jailbreaking etc.
By Chuqiao Lin, Shivaji Sondhi, Xiao-Liang Qi
arXiv:2601.08058v2 Announce Type: replace-cross
Abstract: Chain-of-Thought (CoT) prompting often improves the reasoning performance of large language models (LLMs), but the internal signal that trigg...
By Zhenghao He, Guangzhi Xiong, Bohan Liu, Sanchit Sinha, Aidong Zhang
The paper proposes that self‑improvement methods for language models—such as debate, bootstrap, and internal coherence maximization—can be unified under a framework called coherence optimization. This framework seeks a context‑to‑behavior mapping that is most compressible and jointly predictable, and the authors prove its equivalence to description‑length regularization. They further show that coherence regularization, when guided by a pretrained model prior, optimizes a lower bound on worst‑case accuracy for semi‑supervised learning, offering a theoretical explanation for the success of feedback‑free self‑improvement and predictions about its limits.
By Tianyi Qiu, Ahmed Hani Ismail, Zhonghao He, Shi Feng
arXiv:2606. 24964v1 Announce Type: new Abstract: Understanding the features of large language models (LLMs) is a central goal of interpretability.
By Francisco Ferreira da Silva, Stefan Heimersheim
arXiv:2508.20443v3 Announce Type: replace
Abstract: Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership...
By Zhihao Liu, Jian Lou, Yuke Hu, Xiaochen Li, Yitian Chen, Tailun Chen, Zhizhen Qin, Kui Ren, Zhan Qin