arXiv Machine Learning

Tackling Failure Modes of PINNs and PIKANs Using Conflict-Free Gradients

arXiv Machine Learning
Oct 16

The importance of tensor handling and implementation of physics-informed DeepONets

The paper presents a modified physics-informed DeepONet (PI-DeepONet) architecture that reduces computational cost by eliminating redundancy in the Branch network’s handling of input functions across collocation points. The new formulation is mathematically equivalent to the original but uses smaller input tensors and fewer network evaluations, leading to faster training while maintaining comparable predictive accuracy on 1D, 2D, and 3D linear advection problems. Experiments show up to a 3.75× speed‑up in 2D and enable feasible training of 3D models on an NVIDIA A100 GPU, where the original architecture fails due to memory limits.

By Nahum Banks, Gustavo A. M. de Almeida, Sergio Maldonado
arXiv Machine Learning
Aug 10

Mitigating Gradient Pathology in PINNs through Aligned Constraint

arXiv:2605. 25001v2 Announce Type: replace Abstract: While Physics-Informed Neural Networks (PINNs) are powerful for solving Partial Differential Equations (PDEs), their training is often paralyzed by gradient pathology.

By Yichen Luo, Peiyu Zhu, Dongxiao Hu, Jia Wang, Tailin Wu, Dapeng Lan, Yu Liu, Zhibo Pang
arXiv AI
Oct 5

Geometry Meets Physics: Data-Efficient Pre-Training for Unstructured Neural PDE Solvers

The paper presents a data‑efficient pre‑training framework for neural surrogate models solving PDEs on unstructured 3D geometries. It introduces a geometry‑driven strategy for steady‑state problems that uses intrinsic shape descriptors, and a physics‑driven approach for transient problems that generates synthetic PDE data online. Experiments show faster convergence, higher data efficiency, and improved accuracy during fine‑tuning, especially in low‑data settings.

By Luis Medrano-Navarro, Giacomo Baldan, Qiang Liu, Benjamin Holzschuh, Jan Hagnberger, Mathias Niepert, Nils Thuerey
arXiv Machine Learning
Oct 8

Fourier Feature Pyramids for Physics-Informed Neural Networks

The paper introduces beignet, a neural field architecture that replaces the random Fourier feature embedding in physics-informed neural networks with a trainable multi‑resolution Fourier feature pyramid. By using Fourier interpolation and spectral derivatives, beignet efficiently computes spatial derivatives and scales accuracy through the feature pyramid rather than the neural network size. Experiments show that beignet achieves more accurate PDE solutions with fewer parameters than existing PINN methods and can reach machine‑precision residuals on the inviscid Burgers blowup problem using the Adam optimizer.

By Brandon Zhao, Yixuan Wang, Jonathan T. Barron, Katherine L. Bouman, Dor Verbin, Pratul P. Srinivasan
arXiv Machine Learning
Jul 10

PGD-NO: A Neural Operator with Precomputed Geometry Decomposition for 3D Million-scale Physics Simulations

arXiv:2607. 08025v1 Announce Type: new Abstract: While neural PDE solvers have demonstrated significant potential for accelerating engineering simulations, existing architectures remain constrained by high memory consumption and the single node bottleneck, where the maximum processable mesh resolution is strictly limited by the VRAM of a single compute unit.

By Weiheng Zhong, Jing Bi, Victor Oancea, Hadi Meidani
arXiv Machine Learning
Oct 22

Scalable Stress-Constrained Topology Optimization: A Super-resolution and Simultaneous Approach Based on Machine Learning

The paper introduces the simultaneous neural topology optimization (SNTO) framework, which uses custom neural networks to jointly represent state, adjoint, and design variables in a single optimization loop. SNTO incorporates a multi-component loss function that balances design objectives, aggregated stress constraints, and potential energy, and employs a hardware‑aware training scheme that partitions the design domain across multiple GPUs to handle millions of degrees of freedom. Validation on 2D benchmarks shows super‑resolution designs with sharper boundaries and lower volume fractions, while large‑scale 3D tests demonstrate scalability to eight million collocation points on eight GPUs.

By Xiangyu Sun, Shirin Hosseinmardi, Ramin Bostanabad