The paper introduces Lexical Reference Frames (LexFrame) as a method to interpret language model residual streams by treating each hidden state as having a native reference frame induced by subsequent layers. Unlike fixed lenses or point‑cloud approaches, LexFrame reads a state through the model’s remaining layers using a set number of attention rounds, achieving high coherence (0.97) and accurate state reconstruction (within 0.16 nats). The approach also provides faithful attribution, token‑level steering, and potential early‑exit savings, making every hidden state readable, attributable, and steerable.
By Jian Gu, Hongyu Zhang, Chunyang Chen, Aldeida Aleti
arXiv:2608.31084v1 Announce Type: new
Abstract: The Jacobian Lens (J-lens) is a recent tool for interpreting LLMs. It reads a hidden state as a ranked list of vocabulary tokens, leaving multi-token c...
By Xijie Gong, Tonghan Wang
arXiv:2607. 03502v1 Announce Type: cross Abstract: Frontier LLMs can perform multi-step reasoning over content-free filler tokens like dots or counting sequences, producing correct answers with no visible chain-of-thought (CoT).
By Kaley Brauer, Claudio Mayrink Verdun, Samuel Marks
arXiv:2610.27580v1 Announce Type: cross
Abstract: Factual recall is a lookup: some representation inside the network serves as the key, and what that key is made of decides which queries can retrieve...
By Yuchen Guo, Zhuoyuan Mao, Yiwen Guo
arXiv:2606. 16494v1 Announce Type: cross Abstract: Knowledge-based visual question answering (KB-VQA) lets vision-language systems answer questions that exceed their parametric knowledge by conditioning a reader on passages retrieved from a Wikipedia-scale knowledge base.
By Jieyuan Liu, Jianyang Gu, Shijie Chen, Jefferson Chen, Zhen Wang
arXiv:2606. 31495v1 Announce Type: new Abstract: We study a single idea across two settings: that a prediction-error signal, computed by a small predictor over the latent space of a frozen encoder, can serve both as a gate on plasticity and as a substrate for metacognition.
By Louis Mouchon