arXiv Machine Learning
Using Composition Operators to Linearize LLM Semantic Transformations
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv AI
Jun 11
Harness In-Context Operator Learning with Chain of Operators
arXiv:2606. 12318v1 Announce Type: cross Abstract: Neural operators approximate mappings between function spaces, but often generalize poorly to other operators and usually require fine-tuning or retraining.
arXiv AI
3d ago
Functional Subspace, where language models can use vector algebra to solve problems
The paper proposes that large language models (LLMs) encode high‑level concepts as linear directions within their activation space and that they can use subspaces and vector algebra to perform tasks. By analyzing functional modules and residual streams during in‑context learning (ICL), the authors find that LLMs can create evidence‑accumulating subspaces and solve ICL tasks through simple algebraic operations within those subspaces.
arXiv Machine Learning
Jul 30
Journey Operators for Structured Multi-Axis Composition
arXiv:2607. 26775v1 Announce Type: new Abstract: Many kinds of data have structure along one or more axes: words in a sentence, pixels in an image, nodes in a tree, frames in audio, or cells in a 3D volume.
arXiv Machine Learning
Jul 7
Compositional Generalization Requires Linear, Orthogonal Representations in Vision Embedding Models
arXiv:2602. 24264v2 Announce Type: replace-cross Abstract: Compositional generalization, the ability to recognize familiar parts in novel contexts, is a defining property of intelligent systems.
arXiv Machine Learning
Sep 23
Discovering Data Manifold Geometry through Geometric Properties
arXiv:2602.02611v2 Announce Type: replace Abstract: A prevailing paradigm in modern representation learning is the map-first approach, in which a representation map is learned from reconstruction, em...
arXiv AI
Sep 15
Dissociating performance from compositional feature learning
arXiv:2505.09716v3 Announce Type: replace-cross Abstract: Out-of-distribution (OOD) generalisation is considered a hallmark of human and animal intelligence. To achieve OOD through composition, a sys...