arXiv AI

Geometry-aware Incremental Neural Operator for Long-Horizon PDE prediction

arXiv:2608. 11237v1 Announce Type: new Abstract: Neural operators have shown strong potential for learning solution operators of partial differential equations (PDEs).

arXiv AI
Jun 8

Autoregression-Free Neural Operators for Time-Dependent PDEs

arXiv:2605. 25413v3 Announce Type: replace-cross Abstract: Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs).

By Jiaquan Zhang, Caiyan Qin, Haoyu Bian, Libin Cai, Yi Lu, Chaoning Zhang, Wei Dong, Yuanfang Guo, Yang Yang, Heng Tao Shen
arXiv Machine Learning
Sep 16

Stable by Construction: Variational Latent Markov Operators for Long-Horizon PDE Prediction

The paper introduces a variational framework called VAMO that incorporates latent Markov dynamics for neural PDE solvers, aiming to improve long‑horizon predictions by mitigating error accumulation. By representing physical states as latent distributions and evolving them through probabilistic transitions, the method aligns learned dynamics with a spectral geometry induced by structured Gaussian perturbations. Experiments on fluid‑dynamics benchmarks show that VAMO reduces error growth and enhances rollout stability compared to deterministic and noise‑injection baselines.

By Junyi Liao, Johann Guilleminot, Vahid Tarokh
arXiv Machine Learning
Sep 18

Hypernetwork-Parameterized Spatially Adaptive Neural Operators for PDE Learning

The paper introduces Hypernetwork-Parameterized Spatially Adaptive Neural Operators (SANO) for learning partial differential equations (PDEs) with spatial heterogeneity. SANO replaces spatially shared parameterization with a continuous field of location-dependent operator parameters, generated by a coordinate-conditioned hypernetwork and interpolated via a Hyper-Neural Element mechanism. Experiments on 1‑, 2‑, and 3‑dimensional PDEs and perforated-domain elliptic benchmarks demonstrate that SANO consistently outperforms existing neural‑operator, hypernetwork‑based, and physics‑informed baselines.

By Jiaquan Zhang, Chaoning Zhang, Shuxu Chen, Meng Ye, Xiaofeng Zhang, Qiang He, Weifeng Huang, Guoqing Wang, Yang Yang, Caiyan Qin
arXiv AI
4d ago

Transolver-$\sigma$: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving

Transolver‑σ is a neural PDE solver that jointly models spectral and physical subspaces to improve accuracy in both one‑step and autoregressive rollouts. The method uses adaptive physical-state interactions, Slice‑Residual Physics‑Attention, and an axis‑factorized Fourier operator to enable information exchange between representations. Across five standard PDE benchmarks, Transolver‑σ reduces benchmark‑averaged relative error by 33.4% compared to the strongest baseline and shows strong performance on coupled multiphysics systems and real‑world fluid and combustion data.

By Haonan Shangguan, Hang Zhou, Haixu Wu, Yuezhou Ma, Jianmin Wang, Mingsheng Long
arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville