arXiv Machine Learning

Amortizing Physics-Informed Neural Solvers via Graph Hypernetworks

The paper introduces a method to amortize physics-informed neural networks (PINNs) across related partial differential equations (PDEs) by explicitly modeling equation relationships in an operator graph. Coefficient vectors encode numerical parameters, while the graph hypernetwork generates diagonal codes that initialize a meta‑trained factorized PINN for each target equation. Experiments on scalar convection‑diffusion‑reaction, two‑field Fisher‑KPP, and a capacitively coupled plasma model show that term‑based descriptors and graph conditioning improve solution accuracy compared to coefficient‑vector conditioning, especially for high‑reaction and coupled systems.

Hugging Face Trending Papers
Sep 17

Amortizing Physics-Informed Neural Solvers via Graph Hypernetworks

The paper proposes a method to amortize physics-informed neural networks (PINNs) across related partial differential equations (PDEs) by explicitly modeling equation relationships in an operator graph. Coefficient vectors encode numerical parameters, while the graph hypernetwork generates diagonal codes that initialize a meta‑trained factorized PINN for each target equation. Experiments on scalar convection‑diffusion‑reaction, two‑field Fisher‑KPP, and a capacitively coupled plasma model show that term‑based descriptors and graph conditioning improve solution accuracy compared to coefficient‑vector conditioning alone.

Hugging Face Trending Papers
Jul 13

SPARC-Net: A Spectral, Causality-Aware, and Hard-Constrained Physics-Informed Architecture for Stiff and Shock-Dominated Partial Differential Equations

Physics-Informed Neural Networks (PINNs) provide a meshless approach for solving partial differential equations (PDEs), but suffer severe degradation in stiff and shock-dominated problems, where small PDE residuals can correspond to globally inaccurate solutions. We show these failures are multi-causal, arising from the concurrent interplay of (i) spectral bias against sharp features, (ii) imbalanced multi-term optimization and loss-weight collapse, (iii) violation of temporal causality, and (iv) under-resolved collocation.

arXiv Machine Learning
Aug 27

Physics-Informed Error Field Learning: A Post-Training Optimization Framework for Physics-Informed Neural Networks

Physics-Informed Error Field Learning (PIEFL) is a post‑training optimization framework for Physics‑Informed Neural Networks (PINNs). After a primary network reaches satisfactory accuracy, PIEFL introduces an auxiliary error network that learns the discrepancy between the current approximation and the exact solution by deriving error control equations under physical constraints. The learned error correction is then combined with the primary prediction, improving solution accuracy without modifying the primary network architecture and focusing computational resources on correcting existing prediction errors.

By Jiuyun Sun, Yong Zhang
arXiv Machine Learning
Jul 14

SPARC-Net: A Spectral, Causality-Aware, and Hard-Constrained Physics-Informed Architecture for Stiff and Shock-Dominated Partial Differential Equations

arXiv:2607. 11310v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) provide a meshless approach for solving partial differential equations (PDEs), but suffer severe degradation in stiff and shock-dominated problems, where small PDE residuals can correspond to globally inaccurate solutions.

By Divyavardhan Singh, Dimple Sonone, Hammad Mohammad, Kishor Upla
arXiv Machine Learning
Sep 7

Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

The paper investigates how different attention mechanisms affect the performance of DeepONet neural operators. Five variants—varying in cross‑attention, self‑attention, tokenization, and attention depth—are trained in both data‑driven and physics‑informed settings on one‑ and two‑dimensional PDE benchmarks. Results show that per‑sensor tokenization with cross‑attention consistently reduces error, while branch self‑attention helps only in complex spatial problems, and deeper cross‑attention yields diminishing returns with higher cost.

By Amar Alem Koric, Qibang Liu, Seid Koric
arXiv Machine Learning
Sep 15

Linearized PINN with pretrained nonlinear layers

The paper introduces a linearized Physics-Informed Neural Network (lPINN), a reduced‑order neural basis approach for solving forward and inverse differential equations. In an offline phase, lPINN learns continuous, differentiable neural basis functions from numerical solutions, which are then frozen for new problem instances; the online solution is obtained by minimizing the governing‑equation residual with additional constraints. Experiments on advection‑diffusion, Burgers', and nonlinear pendulum equations show that lPINN achieves lower solution and parameter errors than vanilla PINNs while reducing online inference times by up to three orders of magnitude, and its continuous representation generalizes to finer meshes without retraining.

By Wenhao Chen, Alexandre M. Tartakovsky
arXiv Machine Learning
Oct 5

Hyperparameter selection for equation learning with biologically-informed neural networks

Biologically-informed neural networks (BINNs) are a subclass of physics-informed neural networks tailored for learning partial differential equations in biological systems, where equations are nonlinear and data are sparse. The paper introduces a diagnostic workflow for selecting hyperparameters—network capacity, training epochs, and term stability—without requiring known ground-truth equations. By applying this workflow to synthetic systems, the authors show that validation loss tracks true error and provide practical guidelines and starting values for BINN hyperparameter tuning.

By William Lavery, Jodie A. Cochrane, John T. Nardini, Sara Hamis
arXiv Machine Learning
Jun 5

On the training of physics-informed neural operators for solving parametric partial differential equations

arXiv:2606. 06164v1 Announce Type: new Abstract: Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data.

By Nanxi Chen, Chuanjie Cui, Airong Chen, Sifan Wang, Rujin Ma
arXiv Machine Learning
Sep 29

Gradient Surgery for Physics-Informed Neural Networks

The paper introduces PAM-GS, a physics-aware gradient surgery technique for Physics-Informed Neural Networks (PINNs). It addresses the highly imbalanced multi-task optimisation problem in PINNs by adaptively mitigating task interference based on observed gradient conflicts. Experiments on four PDE benchmarks show that PAM-GS achieves competitive solution accuracy while maintaining strong task-balanced performance, outperforming existing methods on most problems.

By Thomas Borsani, Giuseppe Di Fatta