arXiv Machine Learning

PDE-PFN: Prior-Data Fitted Neural PDE Solver

PDE-PFN is a prior‑data fitted neural solver that uses in‑context learning to approximate the posterior predictive mean of partial differential equation (PDE) solutions. It builds on a Transformer‑based PFN architecture with self‑ and cross‑attention, and is pre‑trained on noisy approximate solutions generated by physics‑informed neural networks. Experiments on various two‑dimensional PDEs show that PDE‑PFN generalizes across heterogeneous equations, remains robust to noisy priors, and can perform zero‑gradient‑update inference while achieving competitive or better predictive accuracy compared to baselines.

Hugging Face Trending Papers
Oct 9

PDE-PFN: Prior-Data Fitted Neural PDE Solver

PDE-PFN is a prior-data fitted neural solver that uses in-context learning to approximate the posterior predictive mean of partial differential equation (PDE) solutions. It builds on a Transformer-based PFN architecture with self- and cross-attention, and is pre‑trained on noisy approximate solutions generated by physics‑informed neural networks. Experiments on various two‑dimensional PDEs show that PDE‑PFN generalizes across heterogeneous equations, remains robust to noisy priors, and can perform zero‑gradient‑update inference while achieving competitive or improved predictive accuracy compared to baselines.

arXiv Machine Learning
Sep 10

Learning functional components of PDEs from data using neural networks

The paper presents a method to recover unknown functional terms in partial differential equations (PDEs) by embedding neural networks into standard parameter estimation workflows. By training on data, the approach learns interaction kernels and external potentials in nonlocal aggregation‑diffusion equations, achieving high accuracy. The study systematically investigates how reconstruction accuracy depends on solution diversity, sampling density, and measurement noise.

By Torkel E. Loman, Yurij Salmaniw, Antonio Leon Villares, Jose A. Carrillo, Ruth E. Baker
arXiv Machine Learning
Sep 7

Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

The paper investigates how different attention mechanisms affect the performance of DeepONet neural operators. Five variants—varying in cross‑attention, self‑attention, tokenization, and attention depth—are trained in both data‑driven and physics‑informed settings on one‑ and two‑dimensional PDE benchmarks. Results show that per‑sensor tokenization with cross‑attention consistently reduces error, while branch self‑attention helps only in complex spatial problems, and deeper cross‑attention yields diminishing returns with higher cost.

By Amar Alem Koric, Qibang Liu, Seid Koric
arXiv Machine Learning
Jun 5

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

arXiv:2605. 08318v2 Announce Type: replace Abstract: We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators.

By Brandon Yee, Pairie Koh, Jack Rodriguez, Mihir Tekal