arXiv Machine Learning
A pullback-corrected scalar auxiliary variable optimizer with momentum and adaptive mobility
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jul 3
An Optimisation Framework for the Well-Conditioned Training of Physics-Informed Neural Networks
arXiv:2607. 02194v1 Announce Type: new Abstract: Physics-informed neural networks (PINNs) have emerged as a promising route to solve partial differential equations, yet they have struggled to reach the precision of classical solvers.
arXiv Machine Learning
Jun 10
Accelerating SAV-based optimization via randomized low-rank Hessian approximation
arXiv:2606. 10562v1 Announce Type: cross Abstract: We propose a new optimization method, the Nystr\"om-enhanced relaxed scalar auxiliary variable method (N-RSAV), which incorporates curvature information into the RSAV framework to accelerate convergence while preserving an unconditional modified energy dissipation law.
arXiv Machine Learning
Jul 27
Energy Manifold Natural Gradient Descent: Riemannian Optimization for Neural PDE Solvers
arXiv:2607. 22004v1 Announce Type: new Abstract: Energy natural gradient descent (ENGD) aligns parameter updates with the curvature of an underlying function-space energy, but existing formulations assume an unconstrained Euclidean parameter domain.
arXiv AI
Sep 1
SS-ESOAP: Self-Scaled Adaptive Preconditioning for Physics-Informed Learning
arXiv:2608.29448v1 Announce Type: cross Abstract: Physics-informed neural networks (PINNs) often face ill-conditioned objectives that limit high-accuracy training. Dense quasi-Newton methods improve...
arXiv Machine Learning
Jun 11
Hybrid Iterative Neural Low-Regularity Integrator for Nonlinear Dispersive Equations
arXiv:2605. 04853v2 Announce Type: replace Abstract: We propose HIN-LRI, a hybrid framework that augments a classical numerical solver with a neural operator trained to correct the solver's structured truncation error.
arXiv Machine Learning
Jun 2
A Per-Component Diagnostic Protocol for Neural HJB-PIDE Solvers under Control-Dependent L\'evy Jumps
arXiv:2606. 01122v1 Announce Type: new Abstract: We propose a five-step diagnostic protocol for residual-trained neural HJB-PIDE solvers with control-dependent L\'evy jumps, targeting a general failure mode of neural PDE methods: a learned solution can match headline scalar diagnostics while miscomputing an operator inside its training loss.