arXiv Machine Learning By Pavlos Protopapas, Kaylee Vo

Variational Boosting for Physics-Informed Neural Networks

Read the original on arXiv Machine Learning →

arXiv:2607. 23940v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) solve differential equations by minimizing the residual of a nonlinear operator over a neural parameterization of the solution.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Aug 28

Physics-Informed Stochastic Configuration Machine: A Backpropagation-Free Neural Network with Fast Training for Nonlinear Differential Equations

The paper introduces the Physics-Informed Stochastic Configuration Machine (PI‑SCM), a backpropagation‑free neural network designed for solving nonlinear differential equations. By analytically evaluating local Jacobians, PI‑SCM linearizes the physical loss, enabling optimal weight determination through generalized linear least squares and avoiding iterative nonlinear optimization. The authors present a progressive algorithmic suite—PI‑SC‑I, PI‑SC‑II, and PI‑SC‑III—prove their universal approximation properties, and show through experiments that PI‑SCM achieves high‑fidelity predictions and parameter identification while accelerating training by orders of magnitude compared to standard PINNs.

By Yuehao Song (School of Automation, Central South University, Changsha, China), Zhong Chen (School of Automation, Central South University, Changsha, China), Lihui Cen (School of Automation, Central South University, Changsha, China), Liang Wu (Johns Hopkins University, Baltimore, USA), Kai Zhang (State Key Laboratory of Simulation and Regulation of Water Cycle in River Basin, China Institute of Water Resources and Hydropower Research, Beijing, China)
arXiv Machine Learning
Jun 19

Evolutionary Two-Stage Hyperparameter Optimization Strategies for Physics-Informed Neural Networks

arXiv:2606. 20442v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) solve Partial Differential Equations (PDEs) by embedding physical laws into neural network training.

By Fedor Buzaev (HSE University), Dmitry Efremenko (HSE University), Egor Bugaev (HSE University), Andrei Ermakov (HSE University, AXXX), Denis Derkach (HSE University), Daria Pugacheva (HSE University, AXXX), Fedor Ratnikov (HSE University)
arXiv Machine Learning
Sep 15

Linearized PINN with pretrained nonlinear layers

The paper introduces a linearized Physics-Informed Neural Network (lPINN), a reduced‑order neural basis approach for solving forward and inverse differential equations. In an offline phase, lPINN learns continuous, differentiable neural basis functions from numerical solutions, which are then frozen for new problem instances; the online solution is obtained by minimizing the governing‑equation residual with additional constraints. Experiments on advection‑diffusion, Burgers', and nonlinear pendulum equations show that lPINN achieves lower solution and parameter errors than vanilla PINNs while reducing online inference times by up to three orders of magnitude, and its continuous representation generalizes to finer meshes without retraining.

By Wenhao Chen, Alexandre M. Tartakovsky
arXiv Machine Learning
Aug 27

StablePDENet: Enhancing Neural Operator Stability through Physics-Informed Residual-Sensitivity Regularization

The paper introduces StablePDENet, a physics-informed adversarial training framework that regularizes the residual sensitivity of neural operators to improve stability against input perturbations. The method formulates operator learning as a min–max optimization, where a physics-based projected‑gradient adversary generates perturbations and the outer objective combines the attacked physics loss with a normalized residual‑sensitivity penalty. Experiments on benchmark problems show that StablePDENet outperforms PI‑DeepONet and its adversarial variant in accuracy under adversarial attacks while maintaining competitive performance on clean data, and it also enhances generalization and highlights the distinction between model sensitivity and intrinsic operator ill‑conditioning.

By Chutian Huang, Chang Ma, Kaibo Wang, Yang Xiang
arXiv Machine Learning
5d ago

Gradient Surgery for Physics-Informed Neural Networks

The paper introduces PAM-GS, a physics-aware gradient surgery technique for Physics-Informed Neural Networks (PINNs). It addresses the highly imbalanced multi-task optimisation problem in PINNs by adaptively mitigating task interference based on observed gradient conflicts. Experiments on four PDE benchmarks show that PAM-GS achieves competitive solution accuracy while maintaining strong task-balanced performance, outperforming existing methods on most problems.

By Thomas Borsani, Giuseppe Di Fatta