The paper introduces Align Latent Rollout (ALR), a regularization technique for neural PDE solvers that encourages consistency across different rollout origins. ALR uses a second‑order Taylor analysis to define two objectives: zeroth‑order consistency aligning latent states at a shared target time, and first‑order consistency aligning local evolution responses to perturbations. The method can be applied to various neural PDE solvers without altering their architectures and demonstrates improved prediction accuracy and reduced discrepancies across rollout origins in multiple benchmarks.
arXiv:2605. 25413v3 Announce Type: replace-cross Abstract: Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs).
arXiv:2505.09063v2 Announce Type: replace Abstract: Solving time-dependent parametric partial differential equations (PDEs) with high-fidelity solvers is expensive in multi-query settings. This motiv...
ReAl: Refine neural operators via aligning dynamical flow introduces a model‑agnostic plug‑in that enhances pretrained PDE surrogates by adding a refinement stage with a conditional flow‑matching model to recover missing high‑frequency structures, and an alignment stage that generates multiple trajectories and uses trajectory‑level rewards to stabilize long‑horizon predictions. The method improves high‑frequency fidelity, forecasting accuracy, and long‑horizon stability across diverse surrogate architectures and PDE tasks.
Neural PDE solvers provide efficient surrogates for time-dependent physical systems, but autoregressive prediction over long horizons remains challenging because local errors can induce distribution s...
The paper introduces a variational framework called VAMO that incorporates latent Markov dynamics for neural PDE solvers, aiming to improve long‑horizon predictions by mitigating error accumulation. By representing physical states as latent distributions and evolving them through probabilistic transitions, the method aligns learned dynamics with a spectral geometry induced by structured Gaussian perturbations. Experiments on fluid‑dynamics benchmarks show that VAMO reduces error growth and enhances rollout stability compared to deterministic and noise‑injection baselines.
The paper introduces a framework for evaluating how well learned states from neural PDE solvers can be reused in new contexts. By separating solution accuracy, learning contribution, and numerical utility through paired state comparisons and cost accounting, the authors audit 12 papers and conduct experiments on linear PDE families, Fourier neural operators, and convolutional networks. Their results show that matched state comparisons and downstream computational evidence can lead to significant savings in conjugate‑gradient iterations and demonstrate finite‑budget pretraining value.
arXiv:2610.06952v1 Announce Type: new Abstract: Neural PDE solvers can achieve low prediction errors, but do they reproduce the dynamics of the systems they model? Prediction scores alone offer an in...
arXiv:2604. 07366v2 Announce Type: replace Abstract: Partial differential equations (PDEs) govern nearly every physical process in science and engineering, but solving them at scale remains prohibitively expensive.
The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.
arXiv:2610. 05337v2 Announce Type: replace-cross Abstract: We identify a mismatch between the physical role of transport fields in many PDEs and their usual role in neural operators: PDEs use them to select read coordinates, whereas neural operators typically treat them only as input values.
arXiv:2606. 27354v1 Announce Type: cross Abstract: Neural surrogate models offer fast approximate mappings from PDE parameters to solutions, but they typically treat solving as a purely statistical task: once trained, they struggle to correct their own constraint violations and extrapolate beyond the training distribution.
arXiv:2610.08475v1 Announce Type: new Abstract: In many-query scenarios, data-driven surrogate models provide an efficient alternative to high-fidelity solvers for simulating physical systems governe...