arXiv:2605. 08318v2 Announce Type: replace Abstract: We study the problem of \emph{architecture selection} for deep learning models trained to solve partial differential equations (PDEs), asking when transformer-based architectures with learned attention outperform Fourier-domain neural operators.
The paper introduces a variational, label‑free physics‑informed graph neural network (PI‑GNN) that models heterogeneous solid mechanics by embedding material heterogeneity into the discretization rather than the neural network’s trial field. The PI‑GNN operates on a conforming adaptive mesh graph, assigns constitutive behavior per element, and minimizes the discrete total potential energy without penalty terms or interface weights, yielding a discrete energy equivalent to the finite element Ritz functional. Across small‑strain elasticity and finite‑strain Neo‑Hookean hyperelasticity in 2D and 3D, the method achieves von Mises errors below 3.58 % over a wide stiffness‑contrast range, outperforming strong‑form PINNs and reducing displacement errors significantly.
The paper presents an energy‑based reduced‑order model for micromagnetic magnetization dynamics that couples a convolutional autoencoder with a latent neural ODE. The latent dynamics are driven by a learned scalar potential via an antisymmetric operator and a symmetric dissipative operator, ensuring monotonic energy decrease while allowing motion along level sets. The model is trained solely on short trajectory windows without explicit physical labels, and shows that antisymmetric‑dissipative and deep‑quadratic energy formulations yield superior long‑term trajectory predictions compared to purely dissipative models.
The paper presents a neural operator that learns the Kohn–Sham map, directly predicting electron density from the Kohn–Sham potential without orbital diagonalization. Using a domain‑invariant SE(3)‑equivariant Fourier neural operator trained on 8,504 molecules and solids, the model achieves quasi‑linear scaling self‑consistent field (SCF) convergence across diverse systems—including organic molecules, insulators, and metals—while reproducing Kohn–Sham DFT accuracy for densities, spectra, and structural observables. This enables large‑scale simulations, such as magnesium dislocation densities with 82,500 valence electrons, on a single GPU.
arXiv:2606. 25971v1 Announce Type: new Abstract: Modern neural network training relies on optimizers such as Adam and Muon which act on each weight matrix as a single object.
arXiv:2602. 12706v2 Announce Type: replace Abstract: Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs).
arXiv:2606. 25600v1 Announce Type: cross Abstract: In the first part of this work, we construct the first type of two-dimensional (2D) hyperbolic neural quantum state (NQS) in the form of the Lorentz 2DRNN (Recurrent Neural Network) and benchmark its performance against the Euclidean 2DRNN in the paradigmatic $N\times N$ 2D Transverse Field Ising Model (2DTFIM) setting with different lattice sizes up to $N=12$ and at different transverse magnetic field strengths.
arXiv:2606. 00371v1 Announce Type: new Abstract: Muon optimizers improve neural-network training by replacing ill-conditioned momentum updates with approximately semi-orthogonal updates.
The paper investigates when frequency decomposition aids Physics-Informed Neural Networks (PINNs) by introducing a dual‑branch, spectrally‑gated architecture (DBSG‑PINN) that separates low‑ and high‑frequency components. Experiments on five one‑dimensional PDE benchmarks show that frequency decomposition significantly reduces error—up to 59.2% on a multimodal wave problem—when the target solution is spectrally complex, but offers little improvement on smoother problems and can even worsen performance on a simple 1D wave benchmark. The adaptive gate’s effectiveness scales with the spectral richness of the solution, suggesting it exploits frequency structure rather than adding noise.
arXiv:2607. 07127v1 Announce Type: cross Abstract: Lattice field theory is the workhorse of non-perturbative physics, used to simulate phenomena from the strong nuclear force to critical phenomena in materials.
arXiv:2606. 14181v1 Announce Type: cross Abstract: Physics-informed neural networks (PINNs) are meshless and carry moving geometry and topology change through resampling of collocation points; the finite-element method (FEM) is the workhorse for boundary-fitted discretisations.
arXiv:2609. 38023v1 Announce Type: new Abstract: Physics-Informed Neural Networks (PINNs) embed governing equations into deep learning, but enforce them only through loss residuals, leaving highly oscillatory wave behavior to be discovered by optimization.