arXiv Machine Learning

When and Why Adversarial Training Improves PINNs: A Neural Tangent Kernel Perspective

arXiv Machine Learning
Oct 9

Gen-PINNs: Generative Adversarial Physics Informed Neural Networks for solving partial differential equations

Gen-PINNs introduces a deterministic residual-adversarial framework that combines Generative Adversarial Networks with Physics-Informed Neural Networks to solve partial differential equations. The method addresses limitations of standard PINNs—such as spectral bias, loss imbalance, and optimizer stagnation—by using a generator that learns the PDE solution with dynamically weighted physics-informed losses and discriminators that assess residuals against zero-residual states. Experiments on nonlinear and higher-order PDEs (Burgers, Allen‑Cahn, Kuramoto‑Sivashinsky) show significant gains in accuracy and convergence, especially for sharp-front, stiff, and high-order problems.

By Muhammad M. Akmal, Kamy Sepehrnoori, Michael J. Pyrcz
arXiv AI
Jun 3

PINNfluence: Interpreting PINNs through Influence Functions

arXiv:2409. 08958v3 Announce Type: replace-cross Abstract: Physics-informed neural networks (PINNs) have emerged as a powerful deep learning approach for solving partial differential equations (PDEs) in the physical sciences, yet their behavior remains largely opaque and is typically understood through failure mode analyses rather than explicit interpretability.

By Aleksander Krasowski, Jonas R. Naujoks, Moritz Weckbecker, Galip \"U. Yolcu, Thomas Wiegand, Sebastian Lapuschkin, Wojciech Samek, Ren\'e P. Klausen
arXiv Machine Learning
Sep 29

Gradient Surgery for Physics-Informed Neural Networks

The paper introduces PAM-GS, a physics-aware gradient surgery technique for Physics-Informed Neural Networks (PINNs). It addresses the highly imbalanced multi-task optimisation problem in PINNs by adaptively mitigating task interference based on observed gradient conflicts. Experiments on four PDE benchmarks show that PAM-GS achieves competitive solution accuracy while maintaining strong task-balanced performance, outperforming existing methods on most problems.

By Thomas Borsani, Giuseppe Di Fatta
arXiv Machine Learning
Aug 27

StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

The paper introduces StablePDENet, a physics-informed adversarial training framework that regularizes the residual sensitivity of neural operators to improve stability against input perturbations. The method formulates operator learning as a min–max optimization, where a physics-based projected‑gradient adversary generates perturbations and the outer objective combines the attacked physics loss with a normalized residual‑sensitivity penalty. Experiments on benchmark problems show that StablePDENet outperforms PI‑DeepONet and its adversarial variant in accuracy under adversarial attacks while maintaining competitive performance on clean data, and it also enhances generalization and highlights the distinction between model sensitivity and intrinsic operator ill‑conditioning.

By Chutian Huang, Chang Ma, Kaibo Wang, Yang Xiang
arXiv Machine Learning
Sep 22

EmbeddGAN: A Novel GAN Framework Using an Embedding Network and Gini Distance Correlation

EmbeddGAN introduces a new GAN framework that replaces the traditional discriminator with an embedding network trained to maximize statistical dependence between embeddings and real/fake labels using Gini distance correlation (gCor). The generator simultaneously minimizes this dependence, encouraging real and generated samples to become indistinguishable in the learned low‑dimensional embedding space. Experiments on MNIST, CIFAR‑10, and CelebA show competitive performance and notably more stable training dynamics compared to established baselines.

By MaTais Caldwell, Yixin Chen, Xin Dang, Charles Walter
arXiv Machine Learning
Jun 5

On the training of physics-informed neural operators for solving parametric partial differential equations

arXiv:2606. 06164v1 Announce Type: new Abstract: Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data.

By Nanxi Chen, Chuanjie Cui, Airong Chen, Sifan Wang, Rujin Ma