arXiv Machine Learning
Sep 1

Autoencoders in Function Space

The paper introduces function‑space versions of autoencoders (FAE) and variational autoencoders (FVAE), analysing their theoretical properties and practical deployment. It highlights that the FVAE objective is well‑defined only when the data distribution aligns with the generative model, a restriction often met when data come from stochastic differential equations. In contrast, the FAE objective remains well‑defined in many cases where FVAE fails, and both can be paired with neural operator architectures to enable tasks such as inpainting, super‑resolution, and generative modelling of scientific data.

By Justin Bunker, Mark Girolami, Hefin Lambley, Andrew M. Stuart, T. J. Sullivan
arXiv Machine Learning
Jul 1

Sparse POD Mode Selection and Manifold Dimensionality Reduction with Neural Networks

arXiv:2605. 27756v2 Announce Type: replace-cross Abstract: Linear dimensionality reduction methods such as proper orthogonal decomposition (POD) make high-dimensional data amenable to analysis by identifying the principal components, or modes, that capture the most variance, or energy, in the data and constructing a low-dimensional representation in the subspace they span.

By Tomoki Koike, Prakash Mohan, Marc T. Henry de Frahan, Elizabeth Qian, Julie Bessac
arXiv Machine Learning
Jul 2

Geometry-Preserving Neural Architectures on Manifolds with Boundary

arXiv:2602. 03082v2 Announce Type: replace Abstract: A growing number of neural architectures have been proposed to enforce geometric constraints, including projection-based networks, exponential-map updates, constrained output layers, and manifold neural ODEs.

By Karthik Elamvazhuthi, Shiba Biswal, Kian Rosenblum, Arushi Katyal, Tianli Qu, Grady Ma, Rishi Sonthalia