arXiv Machine Learning By Itsushi Sakata, Yuta Miyauchi, Yoshinobu Kawahara

Understanding Latent-Dimension Scaling in Dynamical-System Learning through Spectral Reliability

Read the original on arXiv Machine Learning →

The paper investigates how increasing the latent dimension in dynamical‑system learning affects rollout accuracy, using Koopman operator eigenstructure to assess spectral reliability. By comparing models trained with latent‑prediction loss versus spectral‑residual loss across six chaotic systems, the authors find that the spectral‑residual approach consistently yields lower rollout errors and longer valid prediction times, especially as dimension grows. The study demonstrates that focusing on low‑residual eigenpairs aligns better with accurate long‑term dynamics than one‑step prediction alone.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville