arXiv Machine Learning June 11, 2026 By Xuemin Yu, Ankur Garg, Samira Ebrahimi Kahou, Hassan Sajjad

Vector Quantized Latent Concepts: A Scalable Alternative to Clustering-Based Concept Discovery

Read the original on arXiv Machine Learning →

arXiv:2602. 02726v2 Announce Type: replace Abstract: Large language models (LLMs) encode rich semantic information in their hidden states, yet it remains difficult to understand what information these internal representations capture.

Summary generated by The Flow from the publisher's feed. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 11

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

arXiv:2506. 20040v3 Announce Type: replace-cross Abstract: Interpreting language models remains challenging due to the existence of residual stream, which linearly mixes and duplicates features across adjacent layers, causing single-layer analyses to miss this cross-layer structure.

By Ankur Garg, Xuemin Yu, Hassan Sajjad, Samira Ebrahimi Kahou

llms diffusion efficiency

arXiv AI

Jul 7

Explainable Novel Category Discovery in Semantic Concept Space

arXiv:2607. 04548v1 Announce Type: cross Abstract: Novel category discovery aims to identify unseen classes from unlabeled data by transferring knowledge from labeled categories, but most existing methods perform discovery in opaque latent feature spaces.

By Ifrat Ikhtear Uddin, Yang Zhou, KC Santosh, Longwei Wang

multimodal

arXiv AI

Jul 24

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit

arXiv:2512. 10092v2 Announce Type: replace Abstract: Analyzing large-scale text corpora is a core challenge in machine learning, crucial for tasks like identifying undesirable model behaviors or biases in training data.

By Nick Jiang, Xiaoqing Sun, Lisa Dunlap, Lewis Smith, Neel Nanda

llms rag

arXiv AI

Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen

llms rag nlp efficiency benchmarks

arXiv AI

Aug 11

GRACE: LLM-Grounded Semantic Metric Spaces for Scalable Mixed-Data Clustering

arXiv:2608. 07881v1 Announce Type: new Abstract: Clustering mixed tabular data requires a unified metric space to bridge the inherent heterogeneity between continuous numerical measurements and discrete categorical symbols.

By Zihua Yang, Zhencheng Xie, Junyang Chen, Liang Xie, Yiqun Zhang, Mengke Li, Yang Lu

llms rag safety

arXiv AI

Jul 2

Identifying Latent Concepts and Structures for Generalized Category Discovery

arXiv:2607. 00620v1 Announce Type: cross Abstract: Generalized Category Discovery (GCD) aims to recognize known classes while autonomously discovering novel ones in open-world settings.

By Boyang Dai, Chaoqi Chen, Yizhou Yu

rag safety

Related stories

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

Explainable Novel Category Discovery in Semantic Concept Space

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

GRACE: LLM-Grounded Semantic Metric Spaces for Scalable Mixed-Data Clustering

Identifying Latent Concepts and Structures for Generalized Category Discovery