arXiv Machine Learning By Jinyuan Zhang, Peng He, He Hu, Yin Yuan, ShengShuo Jiao

Neither Precision Nor Architecture Alone: Controlled Tests of Failure Remedies for Physics-Informed Neural Networks

Read the original on arXiv Machine Learning →

Physics‑Informed Neural Networks (PINNs) often fail on stiff or advection‑dominated partial differential equations. This study compares two proposed fixes—switching from FP32 to FP64 precision to address an L‑BFGS stopping artifact, and replacing the MLP with a state‑space‑model (SSM) backbone plus sub‑sequence alignment to mitigate architectural simplicity bias—using a pre‑registered, seed‑paired 144‑run experiment across convection, reaction, and wave problems, plus an independent 85‑run study. The results show that the remedies act on disjoint subsets of regimes and seeds: precision changes affect some seeds in opposite directions, alignment improves success in hard convection cases, and the SSM backbone alone succeeds on many reaction seeds, but none of the remedies fully substitutes for the other, and all must be evaluated jointly and reported per seed.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Jun 26

Error-Conditioned Neural Solvers

arXiv:2606. 27354v1 Announce Type: cross Abstract: Neural surrogate models offer fast approximate mappings from PDE parameters to solutions, but they typically treat solving as a purely statistical task: once trained, they struggle to correct their own constraint violations and extrapolate beyond the training distribution.

By Haina Jiang, Liam Wang, Peng-Chen Chen, Min Seop Kwak, Seungryong Kim, Brian Bell, Jeong Joon Park
arXiv Machine Learning
Sep 2

Gradient-Update Mismatch: Rethinking Conflict-Free Training of Physics-Informed Neural Networks

The paper identifies a problem called Gradient-Update Mismatch (GUM), where optimizers can alter conflict-free gradient directions produced by gradient surgery, leading to conflicts between physics residual and boundary condition losses in Physics-Informed Neural Networks (PINNs). To address this, the authors propose Gradient-Update Alignment (GUA), which projects the optimizer’s update onto the conflict-free cone and adjusts internal optimizer state accordingly. Experiments show GUM is common across many optimizers, and GUA consistently eliminates conflicts and significantly reduces error in PINN training.

By Jing Xiao, Xinhai Chen, Qinglin Wang, Menghan Jia, Zhiquan Lai, Dongsheng Li, Jie Liu, Tiejun Li
arXiv Machine Learning
Jun 2

A Per-Component Diagnostic Protocol for Neural HJB-PIDE Solvers under Control-Dependent L\'evy Jumps

arXiv:2606. 01122v1 Announce Type: new Abstract: We propose a five-step diagnostic protocol for residual-trained neural HJB-PIDE solvers with control-dependent L\'evy jumps, targeting a general failure mode of neural PDE methods: a learned solution can match headline scalar diagnostics while miscomputing an operator inside its training loss.

By R. Drissi