arXiv AI
Sep 12

From Parameters to Answers: How LLMs Retrieve and Use Their Internal Knowledge

The paper investigates how large language models (LLMs) such as Qwen, Llama, and Gemma use internal knowledge when answering questions. By performing layer‑wise interventions on the hidden state after the question, the authors compare how different request directions (pair‑conditioned vs. global) and answer types (noun, adjective, code) influence the model’s routing of information. The study finds that the influence of request direction varies across models and layers, with some models showing a sustained routing effect while others do not, highlighting distinct patterns of early readability, causal steering, and later content dependence.

By Wenkang Wei, Yuan Fang, Renhe Jiang, Hong Cheng, Xingtong Yu
arXiv AI
Sep 30

Locating Answer-Correctness Signals in Frozen Large Language Models

The paper investigates where and how large language models encode signals that indicate answer correctness. By examining hidden states, token probabilities, residual-stream features, attention, and their combinations, the authors find that correctness signals are concentrated in the answer span and that different signal families complement each other. Fusing these signals improves robustness, especially under distribution shifts, and can be used to control retrieval in downstream tasks.

By Yuansen Liu, Yixuan Tang, Anthony Kum Hoe Tung
arXiv Machine Learning
6d ago

MicroLens: Read, Trace, and Rewire the Residual Stream with Two Lenses

MicroLens introduces an interactive viewer that overlays two decoding lenses—logit and Jacobian—onto the residual stream of a language model, allowing users to read, trace, and edit token representations on a layers‑by‑tokens grid. Experiments on Gemma‑3‑4B‑it show that the logit lens directs token outputs while the Jacobian lens influences how later tokens interpret information, enabling targeted edits. The tool reveals that key information (e.g., state or country names) can be read and manipulated early in the stream, and that correct answers often appear in the residual stream before reasoning is generated, with the Jacobian lens detecting them slightly earlier than the logit lens.

By Nika Zahedi, Fangyi Zhu, Anna Wu
arXiv Computation and Language
Oct 16

Where Is the "Self" of a Large Language Model? -- From Self-Index to Self-Reference

The paper investigates whether a large language model (LLM) possesses a notion of self by distinguishing between two biological analogues: a self‑index that separates the model’s own material from external material, and self‑reference that allows the model to recognize its own content. Using Qwen3.8‑27B, the authors demonstrate that the model’s internal representations consistently differentiate its own messages across all layers, that the model claims ownership of its messages with a measurable correlation to the self‑index, and that manipulating internal states can reverse or diminish this self‑attribution. The study further shows that the model’s self‑reference ability is enhanced when it engages in a “thinking mode” and that the self‑index influences the model’s performance on arithmetic tasks.

By Yuchen Li, Xintong Li, Zongqi Fan, Ken-tye Yong, Nguyen H. Tran
arXiv Computation and Language
Oct 19

On the Tip of the Tongue: First-Token Cueing as a Behavioral Probe of Recall Failures in LLMs

The paper investigates why large language models often answer factual questions incorrectly in closed‑book settings. It shows that many errors are due to first‑token recall failures: the model commits to an incorrect first token but can complete the correct answer once the right token is provided. Using a First‑Token Cueing probe, the authors demonstrate that correcting just the first token recovers a significant portion of errors across 16 open models and improves accuracy on multilingual benchmarks.

By Jaewon Sok, Jewon Yeom, Seonghyeon Park, Jeongjae Park, Hwiyeong Lee, Taesup Kim