arXiv Machine Learning

Spectral Distillation: From Nonlinear Dynamics to Linear State-Space Models

arXiv:2608. 05416v1 Announce Type: new Abstract: Can nonlinear dynamical systems be learned through a compact linear state-space representation, without directly solving a non-convex system-identification problem?

arXiv Machine Learning
Sep 22

In-context learning from self-generated trajectories for adaptive model reduction

The paper introduces an in‑span adaptation technique for reduced‑order models, where the reduced subspace is continually updated using the model’s own predictions via an incremental singular‑value decomposition with a forgetting factor. This creates a trajectory‑informed spectral preconditioner that reweights and realigns the basis without changing the subspace, enabling the model to better absorb future out‑of‑span corrections. The authors demonstrate the method on a 3‑D spiral example and nonlinear PDEs such as viscous Burgers and Fisher–KPP, and relate the approach to in‑context learning in dynamical systems.

By Amirpasha Hedayat, Laura Balzano, Karthik Duraisamy
arXiv AI
Sep 17

Principled Koopman Representations with Kalman Inference for Efficient Time-Series Prediction

The paper introduces K$^2$SVD, a method that learns the leading singular functions of the Koopman operator by optimizing a Hilbert-Schmidt objective, producing a low‑rank, interpretable Koopman representation with a compact latent space. In this space, temporal evolution is modeled with a linear Gaussian state‑space model and inference is performed via Kalman filtering to reduce noise accumulation in multi‑step predictions. Experiments demonstrate that K$^2$SVD outperforms state‑of‑the‑art methods on multiple datasets, achieving faster prediction speeds and lower computational cost.

By Ruiquan Li, Yuheng Bu
arXiv Machine Learning
Jun 2

Graph Transfer Learning via Shared Latent Geometry: Theory and Applications

arXiv:2606. 00716v1 Announce Type: new Abstract: Inference and control in engineered physical systems pay a heavy physics cost at deployment: state estimators, inverse-problem solvers, model-predictive controllers, schedulers, and observers are often not closed-form and must re-solve a numerical optimization per instance, with the operator re-supplied each time.

By Tong Wu, Andrew Campbell, Anna Scaglione