The paper introduces a method to amortize physics-informed neural networks (PINNs) across related partial differential equations (PDEs) by explicitly modeling equation relationships in an operator graph. Coefficient vectors encode numerical parameters, while the graph hypernetwork generates diagonal codes that initialize a meta‑trained factorized PINN for each target equation. Experiments on scalar convection‑diffusion‑reaction, two‑field Fisher‑KPP, and a capacitively coupled plasma model show that term‑based descriptors and graph conditioning improve solution accuracy compared to coefficient‑vector conditioning, especially for high‑reaction and coupled systems.
By Cheng Jing, Abhishek Verma, Kallol Bera, Yixuan He, Kookjin Lee
Physics-Informed Neural Networks (PINNs) provide a meshless approach for solving partial differential equations (PDEs), but suffer severe degradation in stiff and shock-dominated problems, where small PDE residuals can correspond to globally inaccurate solutions. We show these failures are multi-causal, arising from the concurrent interplay of (i) spectral bias against sharp features, (ii) imbalanced multi-term optimization and loss-weight collapse, (iii) violation of temporal causality, and (iv) under-resolved collocation.
arXiv:2601.12971v2 Announce Type: replace
Abstract: Physics-informed neural networks (PINNs) can be limited by coordinate representations and conflicting gradients from heterogeneous physical constra...
By Pancheng Niu, Jun Guo, Qiaolin He, Yongming Chen, Yanchao Shi
The paper investigates how different attention mechanisms affect the performance of DeepONet neural operators. Five variants—varying in cross‑attention, self‑attention, tokenization, and attention depth—are trained in both data‑driven and physics‑informed settings on one‑ and two‑dimensional PDE benchmarks. Results show that per‑sensor tokenization with cross‑attention consistently reduces error, while branch self‑attention helps only in complex spatial problems, and deeper cross‑attention yields diminishing returns with higher cost.
By Amar Alem Koric, Qibang Liu, Seid Koric
Physics-Informed Error Field Learning (PIEFL) is a post‑training optimization framework for Physics‑Informed Neural Networks (PINNs). After a primary network reaches satisfactory accuracy, PIEFL introduces an auxiliary error network that learns the discrepancy between the current approximation and the exact solution by deriving error control equations under physical constraints. The learned error correction is then combined with the primary prediction, improving solution accuracy without modifying the primary network architecture and focusing computational resources on correcting existing prediction errors.
By Jiuyun Sun, Yong Zhang
The paper introduces a linearized Physics-Informed Neural Network (lPINN), a reduced‑order neural basis approach for solving forward and inverse differential equations. In an offline phase, lPINN learns continuous, differentiable neural basis functions from numerical solutions, which are then frozen for new problem instances; the online solution is obtained by minimizing the governing‑equation residual with additional constraints. Experiments on advection‑diffusion, Burgers', and nonlinear pendulum equations show that lPINN achieves lower solution and parameter errors than vanilla PINNs while reducing online inference times by up to three orders of magnitude, and its continuous representation generalizes to finer meshes without retraining.
By Wenhao Chen, Alexandre M. Tartakovsky