arXiv Machine Learning

The Concept of Representation in ML: Beyond Plato and Aristotle

arXiv:2607. 17800v1 Announce Type: new Abstract: Representation is a central concept in modern machine learning, where it usually refers to internal encodings that support learning and generalization.

arXiv AI
Sep 23

A Survey on the Linear Representation Hypothesis

arXiv:2609.22695v1 Announce Type: new Abstract: The term "linear representation hypothesis" (LRH) has appeared across diverse subfields of artificial intelligence, neuroscience, and cognitive science...

By Sewoong Lee, Marc E. Canby, Ikhyun Cho, Julia Hockenmaier
arXiv AI
Sep 24

The Linear Representation Hypothesis Needs a Group Action

The paper argues that the Linear Representation Hypothesis (LRH) should not be treated as a single claim but as a family of claims differentiated by how representations are considered equivalent. It highlights that different equivalence notions preserve different structures, leading to metrics, probes, and interventions that may actually test distinct hypotheses. By formalizing these ideas with group actions, the authors provide a framework that clarifies how assumptions vary across metrics, reading points, and analysis stages, and they apply it to audit common representation quantities and recent interpretability analyses.

By Louie Hong Yao, Yuhao Li, Shengchao Liu
arXiv Computation and Language
Sep 22

Toward a Unified Mathematics of Concepts

arXiv:2609.24554v1 Announce Type: new Abstract: Concepts are commonly defined as abstract, compact representations of knowledge and treated as basic units of intelligent behavior. Yet, cognition, psy...

By Chen Shani