arXiv Machine Learning

Learning PDE solution operators with variable initial conditions via Latent Dynamics Networks

arXiv Machine Learning
Sep 16

Stable by Construction: Variational Latent Markov Operators for Long-Horizon PDE Prediction

The paper introduces a variational framework called VAMO that incorporates latent Markov dynamics for neural PDE solvers, aiming to improve long‑horizon predictions by mitigating error accumulation. By representing physical states as latent distributions and evolving them through probabilistic transitions, the method aligns learned dynamics with a spectral geometry induced by structured Gaussian perturbations. Experiments on fluid‑dynamics benchmarks show that VAMO reduces error growth and enhances rollout stability compared to deterministic and noise‑injection baselines.

By Junyi Liao, Johann Guilleminot, Vahid Tarokh
arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville
arXiv AI
Sep 30

Transolver-$\sigma$: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving

Transolver‑σ is a neural PDE solver that jointly models spectral and physical subspaces to improve accuracy in both one‑step and autoregressive rollouts. The method uses adaptive physical-state interactions, Slice‑Residual Physics‑Attention, and an axis‑factorized Fourier operator to enable information exchange between representations. Across five standard PDE benchmarks, Transolver‑σ reduces benchmark‑averaged relative error by 33.4% compared to the strongest baseline and shows strong performance on coupled multiphysics systems and real‑world fluid and combustion data.

By Haonan Shangguan, Hang Zhou, Haixu Wu, Yuezhou Ma, Jianmin Wang, Mingsheng Long