arXiv Machine Learning

From inverse problems to neural operators: prediction, mechanism, and generalization of data-driven models

arXiv:2606. 08956v1 Announce Type: new Abstract: Scientists have historically relied on mathematical models based on differential equations to relate system inputs -- forces, fluxes, or heat sources -- to outputs, such as displacement, velocity, concentration, and temperature.

arXiv Machine Learning
22h ago

Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics

The paper introduces a world model that learns to predict the evolution of physical systems while respecting key physical principles. By hard‑coding a general structure—generating dynamics from the gradient of a learned energy via a fixed reversible operator and imposing constraints on energy, dissipation, and interventions—the model achieves second‑law compatible dissipation, accurate responses to parameter changes, long‑term stability, and robustness to disturbances. Experiments on an electromagnetic cavity, a particle‑in‑cell grid, and shallow‑water fluid demonstrate that the model can recover accurate constitutive functions, distinguish conserving from dissipating regimes, and transfer learned physics to unseen conditions, outperforming unconstrained models.

By Yufeng Wang, Parivesh Priye, Lu Wei, Haibin Ling
arXiv Machine Learning
Jun 25

A Zeroth-Order Deep Learning Method for Fully Nonlinear Parabolic Partial Differential Equations with Unknown Coefficients

arXiv:2606. 24999v1 Announce Type: new Abstract: High-dimensional partial differential equations (PDEs) with unknown coefficients arise widely in scientific machine learning, including continuous-time reinforcement learning, yet solving them efficiently in a data-driven way remains challenging.

By Yanwei Jia, Du Ouyang, Huy\^en Pham, Xun Yu Zhou
arXiv AI
Sep 18

Physical knowledge on historical data matters more than enforcing physical constraints on the forecast

The paper introduces a Physics Informed Recurrent Neural Network (PIRNN) that simultaneously predicts target time series and unobservable intermediate physical variables, enhancing robustness and interpretability. It adapts to any physical model with multiple equations and variables, demonstrated on groundwater level predictions using the Gardenia model. Experiments on twelve real‑world datasets show PIRNN outperforming several neural network baselines and the Gardenia model, with an ablation study confirming the value of physical knowledge.

By Etienne Lehembre (CA, LIFO), Pascal Audigane (BRGM), Vincent Nguyen (LIFO), Christel Vrain (LIFO, CA), Thi-Bich-Hanh Dao (LIFO, CA)
arXiv Machine Learning
Aug 31

Examining the robustness of Physics-Informed Neural Networks to noise for Inverse Problems

The paper evaluates the robustness of Physics‑Informed Neural Networks (PINNs) against noisy data in inverse problems, comparing them to a finite element method (FEM) plus optimizer baseline. Experiments on viscosity identification in 1D Burgers’ equation and 2D/3D Taylor‑Green Vortex with additive Gaussian noise show that PINNs, while requiring less human expertise, are outperformed by the traditional FEM approach in accuracy (e.g., RMSE 0.01 vs. 0.0013 for 2D Taylor‑Green with σ=1). PINNs do, however, exhibit better scaling with problem complexity, and the study highlights specific training failures that must be addressed for PINNs to become more competitive.

By Aleksandra Jekic, Afroditi Natsaridou, Signe Riemer-S{\o}rensen, Helge Langseth, Odd Erik Gundersen
arXiv Machine Learning
Sep 15

Linearized PINN with pretrained nonlinear layers

The paper introduces a linearized Physics-Informed Neural Network (lPINN), a reduced‑order neural basis approach for solving forward and inverse differential equations. In an offline phase, lPINN learns continuous, differentiable neural basis functions from numerical solutions, which are then frozen for new problem instances; the online solution is obtained by minimizing the governing‑equation residual with additional constraints. Experiments on advection‑diffusion, Burgers', and nonlinear pendulum equations show that lPINN achieves lower solution and parameter errors than vanilla PINNs while reducing online inference times by up to three orders of magnitude, and its continuous representation generalizes to finer meshes without retraining.

By Wenhao Chen, Alexandre M. Tartakovsky