arXiv Machine Learning

Learning in the Transverse Subspace: A Minimal Representation for Divergence-Free Operator Learning

arXiv Machine Learning
Sep 10

Introductory Notes on Learning$^2$

arXiv:2609.06546v1 Announce Type: cross Abstract: Although machine learning can be used to predict the evolution of physical systems from data, a formulation that learns only the system state at each...

By Sai Siddharth, Maniarasu Ravi
arXiv Machine Learning
Jun 11

Structure-Preserving Neural Surrogates with Tractable Uncertainty Quantification

arXiv:2606. 11650v1 Announce Type: new Abstract: Recent advances in scientific machine learning provide a means of near-real-time solution to partial differential equations (PDEs), but lack the theoretical underpinnings of conventional simulators that support contemporary verification and validation.

By Handi Zhang, Adrienne M. Propp, Brooks Kinch, Houman Owhadi, Nathaniel Trask
arXiv Machine Learning
Jun 9

GENERIC-FNO: Embedding Energy Conservation and Entropy Production into Fourier Neural Operators

arXiv:2606. 08343v1 Announce Type: new Abstract: We introduce GENERIC-FNO, the first neural operator to embed the full GENERIC (metriplectic) structure of nonequilibrium thermodynamics -- reversible, energy-conserving dynamics and irreversible, entropy-producing dynamics coupled through the degeneracy conditions -- directly in function space.

By Jason Sulskis, Sathya Ravi
arXiv Machine Learning
Aug 20

Flux-form spatiotemporal neural operators for coarse-grained dynamics of multiscale PDEs

The paper introduces flux‑form spatiotemporal neural operators for predicting coarse‑grained dynamics of multiscale PDEs without relying on closure models. It learns a surrogate evolution operator from filtered high‑fidelity data, using Fourier convolution for spatial mixing and a causal kernel with time‑lag attention for temporal mixing. The method incorporates a flux‑form inductive bias to maintain conservation and provides a data‑driven rule for selecting memory length, achieving stable, accurate long‑horizon rollouts on benchmark equations and turbulent flow simulations.

By Junfeng Chen
arXiv Machine Learning
Sep 22

In-context learning from self-generated trajectories for adaptive model reduction

The paper introduces an in‑span adaptation technique for reduced‑order models, where the reduced subspace is continually updated using the model’s own predictions via an incremental singular‑value decomposition with a forgetting factor. This creates a trajectory‑informed spectral preconditioner that reweights and realigns the basis without changing the subspace, enabling the model to better absorb future out‑of‑span corrections. The authors demonstrate the method on a 3‑D spiral example and nonlinear PDEs such as viscous Burgers and Fisher–KPP, and relate the approach to in‑context learning in dynamical systems.

By Amirpasha Hedayat, Laura Balzano, Karthik Duraisamy