arXiv AI By Ankur Garg, Xuemin Yu, Hassan Sajjad, Samira Ebrahimi Kahou

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

Read the original on arXiv AI →

arXiv:2506. 20040v3 Announce Type: replace-cross Abstract: Interpreting language models remains challenging due to the existence of residual stream, which linearly mixes and duplicates features across adjacent layers, causing single-layer analyses to miss this cross-layer structure.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv AI.