arXiv Machine Learning

DEFT: Data-Efficient Frequency-domain Top-k Sampling via Inverse Discrete Fourier Transform for Spatiotemporal Dynamical Systems Modeling

arXiv:2608. 11019v1 Announce Type: new Abstract: Modeling spatiotemporal dynamical systems governed by partial differential equations (PDEs) poses two major challenges: it either requires expensive physics-based simulators that entail iterative numerical solving at high computational cost, or it depends on abundant training data, yet purely data-driven models often generalize poorly to downstream dynamic operating conditions.

arXiv Machine Learning
Jun 5

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

arXiv:2605. 08318v2 Announce Type: replace Abstract: We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators.

By Brandon Yee, Pairie Koh, Jack Rodriguez, Mihir Tekal
arXiv AI
4d ago

Transolver-$\sigma$: Joint Spectral-Physical Subspace Modeling for Neural PDE Solving

Transolver‑σ is a neural PDE solver that jointly models spectral and physical subspaces to improve accuracy in both one‑step and autoregressive rollouts. The method uses adaptive physical-state interactions, Slice‑Residual Physics‑Attention, and an axis‑factorized Fourier operator to enable information exchange between representations. Across five standard PDE benchmarks, Transolver‑σ reduces benchmark‑averaged relative error by 33.4% compared to the strongest baseline and shows strong performance on coupled multiphysics systems and real‑world fluid and combustion data.

By Haonan Shangguan, Hang Zhou, Haixu Wu, Yuezhou Ma, Jianmin Wang, Mingsheng Long
arXiv AI
Jun 3

Physics-informed diffusion models in spectral space

arXiv:2602. 09708v2 Announce Type: replace-cross Abstract: We propose physics-informed spectral diffusion (PISD), a methodology that combines generative latent diffusion models with physics-informed machine learning to generate solutions of partial differential equations (PDEs) conditioned on partial observations, which includes, in particular, forward and inverse PDE problems.

By Davide Gallon, Philippe von Wurstemberger, Patrick Cheridito, Arnulf Jentzen
arXiv Machine Learning
Sep 22

Helix-FNO: Spectral-Domain Operator Learning Coupled with a High-Fidelity Mechanistic Model for Fast Surrogate Simulation

Helix‑FNO is a teacher‑student framework that couples a 32‑state mechanistic model with a Fourier neural operator to learn the full solution operator for full‑scale treatment processes. The teacher generates a high‑fidelity dataset via Latin‑hypercube sampling and active learning, while the student learns in the spectral domain, enabling generalisation across varying influent profiles, controls, and plant layouts. The resulting operator achieves millisecond inference, three orders of magnitude faster than the mechanistic teacher, and is evaluated against physics‑informed and data‑driven surrogates on accuracy, dataset efficiency, and latency, positioning it on a speed‑accuracy Pareto front.

By Jiabao Zhao, Chuwei Wang, Jinxi Yang