arXiv Machine Learning

ReAl: Refine neural operators via aligning dynamical flow

ReAl: Refine neural operators via aligning dynamical flow introduces a model‑agnostic plug‑in that enhances pretrained PDE surrogates by adding a refinement stage with a conditional flow‑matching model to recover missing high‑frequency structures, and an alignment stage that generates multiple trajectories and uses trajectory‑level rewards to stabilize long‑horizon predictions. The method improves high‑frequency fidelity, forecasting accuracy, and long‑horizon stability across diverse surrogate architectures and PDE tasks.

arXiv Machine Learning
Aug 7

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

arXiv:2608. 06107v1 Announce Type: new Abstract: Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fast, differentiable surrogate models.

By Guillaume Couairon, Alexis Jacq, Yu-Han Wu, Renu Singh, Yana Hasson, Quentin Berthet, Romuald Elie
arXiv Machine Learning
Oct 16

Same Target, Different Origins: Aligning Latent Rollout for Consistent PDE Emulation

The paper introduces Align Latent Rollout (ALR), a regularization technique for neural PDE solvers that encourages consistency across different rollout origins. ALR uses a second‑order Taylor analysis to define two objectives: zeroth‑order consistency aligning latent states at a shared target time, and first‑order consistency aligning local evolution responses to perturbations. The method can be applied to various neural PDE solvers without altering their architectures and demonstrates improved prediction accuracy and reduced discrepancies across rollout origins in multiple benchmarks.

By Xinying Li, Jing Xu, Wenjun Wang, Limei Han, Fenglei Cao, Ruoxi Jiang, Yuan Qi
arXiv Machine Learning
Sep 25

Beyond Compression: Training Latent Representations for Stable Long-Horizon Rollout in Neural Surrogate Solvers

The paper investigates why latent neural surrogate solvers, which compress physical system dynamics into a lower‑dimensional space, often fail during long‑horizon autoregressive rollouts. It demonstrates that training the latent representation only for reconstruction leads to instability, and proposes a set of training interventions—Koopman operator learning, Hamming noise injection, and multi‑step rollout fine‑tuning—that align the latent space with long‑horizon forecasting. These interventions reduce long‑rollout error by about 40 % and achieve accuracy comparable to full‑resolution models while using far fewer floating‑point operations and GPU memory, enabling stable extrapolation in mesoscale crystal‑plasticity simulations of high‑cycle fatigue.

By Andreas E. Robertson, Ashley T. Lenau, John D. Shimanek, Benjamin A. Jasperson, Vivek Oommen, David L. Damm, Krishna Garikipati, Remi Dingreville
arXiv AI
Jun 8

Autoregression-Free Neural Operators for Time-Dependent PDEs

arXiv:2605. 25413v3 Announce Type: replace-cross Abstract: Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs).

By Jiaquan Zhang, Caiyan Qin, Haoyu Bian, Libin Cai, Yi Lu, Chaoning Zhang, Wei Dong, Yuanfang Guo, Yang Yang, Heng Tao Shen
arXiv Machine Learning
Oct 9

F$^3$NO: Frequency-Decomposed Finite-Time Flow-map Neural Operators with Cross-Scale Conditioning

F$^3$NO is a frequency‑decomposed finite‑time flow‑map neural operator that uses low‑frequency features to guide the refinement of high‑frequency information through cross‑scale conditioning within each layer. The model predicts future states directly for specified times and adjusts the contributions of its two branches based on the prediction interval. Experiments on five PDE benchmarks show that F$^3$NO outperforms autoregressive and direct‑prediction baselines, and ablation studies reveal that frequency‑decomposed refinement improves accuracy with fewer parameters while segmentation benefits vary with spatial resolution and dynamical regime.

By Fan Wu, Cheng Jing, Kookjin Lee
arXiv AI
Aug 3

HERO: History-Enriched Rollout Training for Long-Horizon Autoregressive Neural Operators

arXiv:2607. 29135v1 Announce Type: cross Abstract: Neural operators provide fast surrogates for time-dependent partial differential equations (PDEs) by applying a learned evolution operator recursively to its own predictions, but this autoregressive rollout feeds every prediction error back as input, so local errors accumulate.

By Jiaquan Zhang, Shuxu Chen, Haifan Meng, Yi Lu, Zhihan Lyu, Fan Mo, Wei Dong, Yang Yang, Chaoning Zhang