arXiv Machine Learning June 11, 2026 By Xuemin Yu, Ankur Garg, Samira Ebrahimi Kahou, Hassan Sajjad

Vector Quantized Latent Concepts: A Scalable Alternative to Clustering-Based Concept Discovery

Read the original on arXiv Machine Learning →

arXiv:2602. 02726v2 Announce Type: replace Abstract: Large language models (LLMs) encode rich semantic information in their hidden states, yet it remains difficult to understand what information these internal representations capture.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI

Jun 11

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

arXiv:2506. 20040v3 Announce Type: replace-cross Abstract: Interpreting language models remains challenging due to the existence of residual stream, which linearly mixes and duplicates features across adjacent layers, causing single-layer analyses to miss this cross-layer structure.

By Ankur Garg, Xuemin Yu, Hassan Sajjad, Samira Ebrahimi Kahou

llms diffusion efficiency

arXiv Machine Learning

Aug 26

How to Achieve the Intended Aim of Deep Clustering Now, without Deep Learning

The paper examines whether Deep Embedded Clustering (DEC) truly overcomes the fundamental limitations of k‑means clustering, such as handling clusters of arbitrary shapes, varied sizes, and densities. Through analysis, it finds that DEC does not exploit the underlying data distribution and therefore fails to address these limitations. Instead, a non‑deep learning approach that leverages distributional information of clusters can achieve the intended goals of deep clustering.

By Kai Ming Ting, Wei-Jie Xu, Hang Zhang

arXiv AI

Jul 7

Explainable Novel Category Discovery in Semantic Concept Space

arXiv:2607. 04548v1 Announce Type: cross Abstract: Novel category discovery aims to identify unseen classes from unlabeled data by transferring knowledge from labeled categories, but most existing methods perform discovery in opaque latent feature spaces.

By Ifrat Ikhtear Uddin, Yang Zhou, KC Santosh, Longwei Wang

multimodal

arXiv AI

Jul 24

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit

arXiv:2512. 10092v2 Announce Type: replace Abstract: Analyzing large-scale text corpora is a core challenge in machine learning, crucial for tasks like identifying undesirable model behaviors or biases in training data.

By Nick Jiang, Xiaoqing Sun, Lisa Dunlap, Lewis Smith, Neel Nanda

llms rag

arXiv Computation and Language

Sep 21

VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits

arXiv:2505.10202v2 Announce Type: replace Abstract: Large Language Models (LLMs) have achieved remarkable success but face significant computational and memory challenges, particularly due to their e...

By Jintian Shao, Hongyi Huang, Jiayi Wu, YiMing Cheng, ZhiYu Wu, You Shan, MingKai Zheng

llms rag efficiency benchmarks

arXiv AI

Jun 3

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models

arXiv:2510. 09711v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have recently emerged as a powerful paradigm for Knowledge Graph Completion (KGC), offering strong reasoning and generalization capabilities beyond traditional embedding-based approaches.

By Wenbin Guo, Xin Wang, Jiaoyan Chen, Lingbing Guo, Zhao Li, Zirui Chen

llms rag nlp efficiency benchmarks

One email a morning, machine-written

Related stories

Cross-Layer Discrete Concept Discovery for Interpreting Language Models

How to Achieve the Intended Aim of Deep Clustering Now, without Deep Learning

Explainable Novel Category Discovery in Semantic Concept Space

Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit

VQ-Logits: Compressing the Output Bottleneck of Large Language Models via Vector Quantized Logits

ReaLM: Residual Quantization Bridging Knowledge Graph Embeddings and Large Language Models