arXiv AI

Spectral Alignment in Forward-Backward Representations via Temporal Abstraction

arXiv Machine Learning
Aug 31

Shift Before You Learn: Enabling Low-Rank Representations in Reinforcement Learning

The paper challenges the common assumption that the successor measure in reinforcement learning is approximately low-rank, showing instead that a low-rank structure emerges in a shifted successor measure that ignores initial transitions. It provides finite-sample guarantees for estimating this low-rank approximation, introduces Type II Poincaré inequalities to bound spectral recoverability, and links the necessary shift to the decay of high-order singular values and local mixing properties. Experiments confirm that shifting the successor measure improves goal-conditioned RL performance.

By Bastien Dubail, Stefan Stojanovic, Alexandre Prouti\`ere
arXiv Machine Learning
Aug 24

SPARCL: Spectral Partitioned Analytic Continual Learning

SPARCL introduces a spectral partitioned analytic continual learning method that addresses forgetting in analytic class‑incremental learning. By decomposing the running autocorrelation into a high‑energy core and a residual complement, SPARCL freezes core components for old classes and updates only the residual block, ensuring closed‑form updates with an invariance guarantee. Experiments on CIFAR‑100, CUB‑200, ImageNet‑R, and ImageNet‑A with a frozen ViT‑B/16 protocol show that SPARCL narrows the performance gap between classical analytic learners and strong representation matchers while complementing sparse feature‑decorrelation approaches.

By James Hartley, Zeropy Surio, Daniel Whitmore, Hannah Clarke, Thomas Reed
arXiv AI
Aug 25

FreKoo++: Learning Continuous Spectral Dynamics for Temporal Domain Generalization

FreKoo++ is a continuous spectral-dynamical framework designed for Temporal Domain Generalization (TDG). It unifies continuous Koopman modal dynamics with adaptive spectral disentanglement, mapping source-domain parameters into a latent space and modeling their evolution as a superposition of learnable continuous modes. The method handles irregular timestamps, supports arbitrary horizon extrapolation, and introduces an adaptive soft spectral weighting mechanism that isolates persistent dynamics from transient noise, achieving state‑of‑the‑art performance on discrete and continuous TDG benchmarks.

By En Yu, Xiaoyu Yang, Wei Duan, Guangquan Zhang, Jie Lu
arXiv AI
Oct 15

World Modeling through Spectral Alignment

arXiv:2610.15429v1 Announce Type: cross Abstract: How do we tell a world model what information to preserve? We study this question through the lens of spectral representation learning. We introduce...

By Holger Molin, William Peng, Marco Bagatella, Randall Balestriero
arXiv Machine Learning
Oct 3

Learning Commute-Time-Preserving World Models for Planning

The paper introduces Commute-Time-Preserving World Models (CTWMs), which learn latent representations that reflect commute-times in an environment by using a latent displacement predictor and a log-determinant regularizer. This approach addresses the issue that existing self-supervised methods degrade the necessary eigenvalue-dependent scaling for accurate commute-time representation. In experiments, CTWMs outperform the task-agnostic baseline LeWM on several continuous goal-reaching benchmarks while using only half the parameters.

By Michael Hauri, Peter Buttaroni, Fabian A. Mikulasch, Friedemann Zenke