arXiv Machine Learning

Hybrid coupling with numerics-informed neural networks and the overlapping Schwarz alternating method

arXiv AI
1d ago

Adaptive hybrid coupling with operator inference, the overlapping Schwarz alternating method and reinforcement learning

The paper presents a reinforcement‑learning framework that dynamically selects between full‑order models (FOMs) and reduced‑order models (ROMs) in hybrid domain decomposition simulations using the overlapping Schwarz alternating method (O‑SAM). Offline‑trained Deep Q‑networks choose subdomain‑local FOMs or pre‑trained Operator Inference ROMs based on a reward that balances accuracy, computational cost, and model‑switching frequency, and the learned policies are deployed on unseen problem instances without needing a reference FOM solution. Experiments on a 1D advection‑diffusion problem and a 3D elastic wave propagation benchmark show that the RL‑guided policies adaptively allocate high‑fidelity resolution as features propagate, outperforming static FOM/ROM assignments and demonstrating the feasibility of predictive online fidelity adaptation in Schwarz‑based hybrid simulations.

By Trishit Mondal, Irina Tezaur, Anthony Gruber
arXiv Machine Learning
Jul 14

Multi-dimensional training-priority weighting based on physical information propagation paths: a unified residual-weighting framework for physics-informed neural networks

arXiv:2607. 11094v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) have shown promise for solving partial differential equations (PDEs); however, their synchronous optimization treats residuals of different regions and constraints equally, which is inconsistent with the progressive "from source to response" physical information propagation path, degrading training stability and accuracy.

By Zhangyi Lian, Xinda Dong, Wenxuan Huo, Weifeng Huang, Gang Zhu, Qiang He
arXiv Machine Learning
Jun 5

When Attention Beats Fourier: Multi-Scale Transformers for PDE Solving on Irregular Domains

arXiv:2605. 08318v2 Announce Type: replace Abstract: We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators.

By Brandon Yee, Pairie Koh, Jack Rodriguez, Mihir Tekal
arXiv Machine Learning
3d ago

Linearized PINN with pretrained nonlinear layers

The paper introduces a linearized Physics-Informed Neural Network (lPINN), a reduced‑order neural basis approach for solving forward and inverse differential equations. In an offline phase, lPINN learns continuous, differentiable neural basis functions from numerical solutions, which are then frozen for new problem instances; the online solution is obtained by minimizing the governing‑equation residual with additional constraints. Experiments on advection‑diffusion, Burgers', and nonlinear pendulum equations show that lPINN achieves lower solution and parameter errors than vanilla PINNs while reducing online inference times by up to three orders of magnitude, and its continuous representation generalizes to finer meshes without retraining.

By Wenhao Chen, Alexandre M. Tartakovsky
arXiv Machine Learning
Sep 7

Disentangling Attention in Deep Operator Learning: A Controlled Study of Data-Driven and Physics-Informed Architectures

The paper investigates how different attention mechanisms affect the performance of DeepONet neural operators. Five variants—varying in cross‑attention, self‑attention, tokenization, and attention depth—are trained in both data‑driven and physics‑informed settings on one‑ and two‑dimensional PDE benchmarks. Results show that per‑sensor tokenization with cross‑attention consistently reduces error, while branch self‑attention helps only in complex spatial problems, and deeper cross‑attention yields diminishing returns with higher cost.

By Amar Alem Koric, Qibang Liu, Seid Koric
arXiv Machine Learning
Jun 17

INI-VPINN: A Variational Physics-Informed Neural Network with Implicit Neumann and Interface Handling for Multi-Material Domains with Geometric Singularities

arXiv:2606. 18032v1 Announce Type: cross Abstract: We propose a new weak-form Physics-Informed Neural Network approach (named INI-VPINN).

By Shayan Dodge (DESTeC, University of Pisa, Pisa, Italy), Alessandro Formisano (Department of Engineering, University of Campania Luigi Vanvitelli, Aversa, Italy), Sami Barmada (DESTeC, University of Pisa, Pisa, Italy)