Introductory Notes on Learning$^2$
arXiv:2609.06546v1 Announce Type: cross Abstract: Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each...
arXiv:2609.06546v1 Announce Type: cross Abstract: Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each...
arXiv:2510. 25306v3 Announce Type: replace Abstract: Partial physical knowledge--governing structures known, constitutive relations or their combinations not--pervades spatiotemporal systems.
arXiv:2606. 11650v1 Announce Type: new Abstract: Recent advances in scientific machine learning provide a means of near-real-time solution to partial differential equations (PDEs), but lack the theoretical underpinnings of conventional simulators that support contemporary verification and validation.
arXiv:2608.24049v1 Announce Type: new Abstract: Neural operators provide efficient surrogates for spatiotemporal PDE systems, but purely data-driven formulations often accumulate substantial errors d...
arXiv:2606. 08343v1 Announce Type: new Abstract: We introduce GENERIC-FNO, the first neural operator to embed the full GENERIC (metriplectic) structure of nonequilibrium thermodynamics -- reversible, energy-conserving dynamics and irreversible, entropy-producing dynamics coupled through the degeneracy conditions -- directly in function space.
arXiv:2608. 09764v1 Announce Type: cross Abstract: Transformer-based neural operators have achieved substantial progress in solving Partial Differential Equations (PDEs) by projecting spatial observations into compact latent tokens and learning physical interactions in latent spaces.
arXiv:2410. 10137v5 Announce Type: replace Abstract: We develop Riemannian approaches to variational autoencoders (VAEs) for PDE-type ambient data with regularizing geometric latent dynamics, which we refer to as VAE-DLM, or VAEs with dynamical latent manifolds.
arXiv:2603. 12676v3 Announce Type: replace Abstract: Generalizing neural surrogate models across different PDE parameters remains difficult because changes in PDE coefficients often make learning harder and optimization less stable.
The paper introduces flux‑form spatiotemporal neural operators for predicting coarse‑grained dynamics of multiscale PDEs without relying on closure models. It learns a surrogate evolution operator from filtered high‑fidelity data, using Fourier convolution for spatial mixing and a causal kernel with time‑lag attention for temporal mixing. The method incorporates a flux‑form inductive bias to maintain conservation and provides a data‑driven rule for selecting memory length, achieving stable, accurate long‑horizon rollouts on benchmark equations and turbulent flow simulations.
arXiv:2606. 06171v1 Announce Type: cross Abstract: Physics-Informed Neural Networks inherently suffer from task interference because they rely on a shared parameter space to satisfy both governing differential equations and boundary conditions.
The paper introduces an in‑span adaptation technique for reduced‑order models, where the reduced subspace is continually updated using the model’s own predictions via an incremental singular‑value decomposition with a forgetting factor. This creates a trajectory‑informed spectral preconditioner that reweights and realigns the basis without changing the subspace, enabling the model to better absorb future out‑of‑span corrections. The authors demonstrate the method on a 3‑D spiral example and nonlinear PDEs such as viscous Burgers and Fisher–KPP, and relate the approach to in‑context learning in dynamical systems.
arXiv:2607. 27924v1 Announce Type: new Abstract: In the physical world we inhabit, space and time are fundamentally continuous.