arXiv Machine Learning

Self-Supervised Learning of Universal Latent Spaces for Operator Learning

arXiv Machine Learning
Oct 2

Function-Space Transformer with Adaptive Anchors

The paper introduces the Function‑Space Transformer (FST), a neural framework that learns from functions by using a spatially adaptive continuous latent representation. FST places features at anchors whose positions are predicted from input samples and refines these anchors through recursive function‑space interactions, allowing the representation to adapt to each input rather than relying on a fixed grid. Experiments on PDEBench (Burgers and Darcy flow) and ImageNet‑1K show that FST outperforms or matches state‑of‑the‑art baselines such as Perceiver IO and the Vision Transformer while using fewer parameters.

By Guorui Sang, Pedram Rooshenas
arXiv AI
Aug 17

ArGEnT: Arbitrary Geometry-encoded Transformer for Operator Learning

arXiv:2602. 11626v3 Announce Type: replace-cross Abstract: Learning solution operators on arbitrary geometries remains a central challenge in scientific machine learning, especially for many-query simulation, physics-informed learning, and evolving geometries requiring accurate, geometry-aware predictions at arbitrary spatial locations.

By Wenqian Chen, Zhi-Feng Wei, Yucheng Fu, Michael Penwarden, Pratanu Roy, Panos Stinis
arXiv AI
Sep 2

Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains

The paper introduces GeoLAMP, a Geometry-aware Latent Autoregressive generative Model designed to solve multiphysics partial differential equations in highly irregular, micro‑scale tortuous geometries. GeoLAMP employs a dual‑encoder graph architecture to capture both global topology and fine‑scale geometry, transforms real‑space fields into compact latent representations, and uses a causal self‑attention transformer with flow matching for stable, scalable block‑wise autoregressive prediction. The model is evaluated on three benchmark datasets—reactive flow, heat convection, and elasticity—showing consistently low errors across the entire rollout horizon.

By Zi Wang, Minghui Xu, Tapan Mukerji
arXiv Machine Learning
Sep 17

HiLNO: A Hierarchical Latent Neural Operator with Multi-Scale Supervision for PDEs on General Geometries

HiLNO is a hierarchical latent neural operator that builds a fine‑to‑coarse‑to‑fine latent space and incorporates multi‑scale supervision and anisotropic Gaussian attention to preserve spatial information in PDE solutions with multiscale structures. The hierarchy reduces information loss during compression, while multi‑scale supervision aligns intermediate predictions with downsampled targets, and anisotropic attention facilitates feature transfer across scales. Experiments on standard PDE benchmarks and a large‑scale automotive aerodynamics task show that HiLNO achieves competitive accuracy while cutting parameter count by 84.4% and FLOPs by 69.2% compared with LinearNO, and it generalizes effectively to unseen spatial resolutions.

By Zhicheng Hu, Jiacheng Li, Min Yang