arXiv Machine Learning

Deep Invertible Autoencoders for Dimensionality Reduction of Dynamical Systems

arXiv Machine Learning
Sep 1

Autoencoders in Function Space

The paper introduces function‑space versions of autoencoders (FAE) and variational autoencoders (FVAE), analysing their theoretical properties and practical deployment. It highlights that the FVAE objective is well‑defined only when the data distribution aligns with the generative model, a restriction often met when data come from stochastic differential equations. In contrast, the FAE objective remains well‑defined in many cases where FVAE fails, and both can be paired with neural operator architectures to enable tasks such as inpainting, super‑resolution, and generative modelling of scientific data.

By Justin Bunker, Mark Girolami, Hefin Lambley, Andrew M. Stuart, T. J. Sullivan
arXiv Machine Learning
Jul 1

Sparse POD Mode Selection and Manifold Dimensionality Reduction with Neural Networks

arXiv:2605. 27756v2 Announce Type: replace-cross Abstract: Linear dimensionality reduction methods such as proper orthogonal decomposition (POD) make high-dimensional data amenable to analysis by identifying the principal components, or modes, that capture the most variance, or energy, in the data and constructing a low-dimensional representation in the subspace they span.

By Tomoki Koike, Prakash Mohan, Marc T. Henry de Frahan, Elizabeth Qian, Julie Bessac
arXiv Machine Learning
Jul 2

Geometry-Preserving Neural Architectures on Manifolds with Boundary

arXiv:2602. 03082v2 Announce Type: replace Abstract: A growing number of neural architectures have been proposed to enforce geometric constraints, including projection-based networks, exponential-map updates, constrained output layers, and manifold neural ODEs.

By Karthik Elamvazhuthi, Shiba Biswal, Kian Rosenblum, Arushi Katyal, Tianli Qu, Grady Ma, Rishi Sonthalia
arXiv Machine Learning
Sep 1

Sensitivity-Constrained Neural Operators for Data-Efficient Forward and Inverse Modeling of Partial Differential Equation Systems

The paper introduces Sensitivity‑Constrained Neural Operators (SC‑NOs), which augment standard neural operator training with sampled Jacobian supervision from differentiable solvers or discrete adjoints. By matching selected sensitivities during training, SC‑NOs improve forward prediction accuracy and significantly enhance gradient‑based inverse reconstruction for distributed fields. Experiments on advection–diffusion, RANS–Spalart–Allmaras, high‑dimensional gridded inputs, and a shallow‑water tsunami source‑inversion case demonstrate that SC‑NOs achieve a better accuracy–cost trade‑off and enable near‑real‑time wave‑propagation forecasting from sparse observations.

By Abdolmehdi Behroozi, Chaopeng Shen, Daniel Kifer, Kathryn Lawson
Hugging Face Trending Papers
Jun 17

Advances in Scientific Machine Learning for Coupled Fluid Flow and Transport

This chapter reviews recent advances in Scientific Machine Learning (SciML) for modeling coupled fluid flow and transport phenomena governed by the incompressible Navier-Stokes and scalar transport equations. Such systems, found in applications like turbidity currents and thermal convection, feature strong nonlinear coupling and multiscale behavior that make high-fidelity simulations computationally expensive.

arXiv AI
Aug 6

The Hamilton-Jacobi Theory of Deep Learning

arXiv:2605. 28983v2 Announce Type: replace-cross Abstract: In this paper, training a neural network is identified, exactly, as a search through Hamilton--Jacobi initial-value problems: each gradient step selects the initial data of a viscous Hamilton--Jacobi equation whose Hopf--Cole propagator best fits the observations; at inference, the input is the spatial point at which that solution is evaluated and the initial condition is already encoded in the weights.

By Jose Marie Antonio Mi\~noza, Erika Fille T. Legara, Christopher P. Monterola