arXiv AI
Jun 8
The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlook
arXiv:2604. 02029v2 Announce Type: replace Abstract: Latent space is rapidly emerging as a native substrate for language-based models.
Visualizing LLM Latent Space Geometry Through Dimensionality Reduction
arXiv:2511. 21594v3 Announce Type: replace Abstract: Large language models (LLMs) achieve state-of-the-art results across many natural language tasks, but their internal mechanisms remain difficult to interpret.
Related stories
arXiv AI
Jun 12
LatentLens: Revealing Highly Interpretable Visual Tokens in LLMs
arXiv:2602. 00462v4 Announce Type: replace-cross Abstract: Transforming a large language model (LLM) into a vision-language model (VLM) can be achieved by mapping the visual tokens from a vision encoder into the embedding space of an LLM.
arXiv Machine Learning
Jun 30
AnTenA: Actionable and Explainable Tensor Analysis System with Large Language Models
arXiv:2606. 28708v1 Announce Type: cross Abstract: Accurately explaining hidden patterns in multi-aspect data has typically been done by leveraging labels and/or accompanying auxiliary metadata.
arXiv Machine Learning
Jul 15
Hierarchical Latent Structures in Data Generation Process Unify Mechanistic Phenomena across Scale
arXiv:2603. 06592v2 Announce Type: replace-cross Abstract: Contemporary studies in mechanistic interpretability have uncovered many puzzling phenomena in the neural information processing of Transformer-based language models, such as induction heads, function vectors, and the Hydra effect.
arXiv Machine Learning
Jun 4
Equivariant Latent Alignment via Flow Matching under Group Symmetries
arXiv:2605. 30705v2 Announce Type: replace-cross Abstract: Geometry-aware generative models and novel view synthesis approaches have shown strong potential in visual fidelity and consistency.
arXiv AI
Jun 11
ICA Lens: Interpreting Language Models Without Training Another Dictionary
arXiv:2606. 11722v1 Announce Type: cross Abstract: Finding interpretable directions in language-model representations is critical for understanding and controlling model behavior.
arXiv AI
Jun 24
Mind the Heads: Topological Representation Alignment for Multimodal LLMs
arXiv:2606. 23885v1 Announce Type: cross Abstract: Representation alignment has emerged as an effective approach to improve Multimodal Large Language Models (MLLMs) by regularizing their internal representations toward those of an external vision encoder.
arXiv Machine Learning
Jul 1
Symmetry in language statistics shapes the geometry of model representations
arXiv:2602. 15029v3 Announce Type: replace Abstract: The internal representations learned by language models consistently exhibit striking geometric structure: calendar months organize into a circle, historical years form a smooth one-dimensional manifold, and cities' latitudes and longitudes can be decoded using a linear probe.
arXiv AI
Jul 14
Laguerre Geometry for Interpreting Large Language Models
arXiv:2607. 10578v1 Announce Type: new Abstract: Existing hypotheses represent a concept in an LLM as a single point, a linear direction, or a Gaussian cluster, yet it remains unclear how and why such structures emerge.
arXiv Machine Learning
Jul 27
LatentFlow: Visual Analytics for Latent Space Analysis in Molecular Graph Neural Networks
arXiv:2607. 21941v1 Announce Type: new Abstract: Chemists and materials scientists increasingly use machine learning models, such as graph neural networks (GNNs), to predict properties of molecules and the outcomes of their reactions.
arXiv Machine Learning
Aug 4
Riemannian Attention Mechanisms for Transformers: A Theoretical Framework and Architecture Design
arXiv:2608. 01283v1 Announce Type: new Abstract: All Transformer-based large language models compute attention via the Euclidean inner product, an architectural choice that Dong et al.
arXiv Machine Learning
Jun 19
What Makes Effective Supervision in Latent Chain-of-Thought: An Information-Theoretic Analysis
arXiv:2606. 20075v1 Announce Type: new Abstract: Latent Chain-of-Thought (CoT) internalizes reasoning within continuous hidden states, offering a promising alternative to verbose discrete reasoning traces.