arXiv Machine Learning
Oct 16

The importance of tensor handling and implementation of physics-informed DeepONets

The paper presents a modified physics-informed DeepONet (PI-DeepONet) architecture that reduces computational cost by eliminating redundancy in the Branch network’s handling of input functions across collocation points. The new formulation is mathematically equivalent to the original but uses smaller input tensors and fewer network evaluations, leading to faster training while maintaining comparable predictive accuracy on 1D, 2D, and 3D linear advection problems. Experiments show up to a 3.75× speed‑up in 2D and enable feasible training of 3D models on an NVIDIA A100 GPU, where the original architecture fails due to memory limits.

By Nahum Banks, Gustavo A. M. de Almeida, Sergio Maldonado
arXiv Machine Learning
Aug 10

Mitigating Gradient Pathology in PINNs through Aligned Constraint

arXiv:2605. 25001v2 Announce Type: replace Abstract: While Physics-Informed Neural Networks (PINNs) are powerful for solving Partial Differential Equations (PDEs), their training is often paralyzed by gradient pathology.

By Yichen Luo, Peiyu Zhu, Dongxiao Hu, Jia Wang, Tailin Wu, Dapeng Lan, Yu Liu, Zhibo Pang
arXiv AI
Oct 5

Geometry Meets Physics: Data-Efficient Pre-Training for Unstructured Neural PDE Solvers

The paper presents a data‑efficient pre‑training framework for neural surrogate models solving PDEs on unstructured 3D geometries. It introduces a geometry‑driven strategy for steady‑state problems that uses intrinsic shape descriptors, and a physics‑driven approach for transient problems that generates synthetic PDE data online. Experiments show faster convergence, higher data efficiency, and improved accuracy during fine‑tuning, especially in low‑data settings.

By Luis Medrano-Navarro, Giacomo Baldan, Qiang Liu, Benjamin Holzschuh, Jan Hagnberger, Mathias Niepert, Nils Thuerey