arXiv Machine Learning

Data-driven discovery of intrinsic Lie point symmetries of differential equation systems

The paper presents a data-driven method for discovering intrinsic Lie point symmetries of differential equation systems directly from sampled jet-space data. By formulating symmetry discovery as an operator-theoretic problem, the approach identifies admissible generators, separates them from redundant or trivial directions, and reconstructs the full symmetry algebra, including its Lie-bracket structure, on benchmark systems. The method demonstrates that explicit continuous-symmetry generators can be recovered from data generated by both exact and approximate differential systems.

arXiv Machine Learning
Aug 27

Loss Landscape Geometry of Partial Differential Equation Emulators: Or, Symmetry Learning via Gradient Alignment

The paper introduces a diagnostic tool that measures how neural emulators of partial differential equations capture physical symmetries by evaluating the overlap of loss gradients along symmetry-related states. This metric probes the local geometry of the learned loss landscape and goes beyond traditional equivariance tests by directly assessing learning dynamics. Applied to autoregressive fluid flow emulators, the study shows that orbit-wise gradient coherence enables generalization over symmetry transformations and reveals when training selects a symmetry-compatible basin.

By James Amarel, Robyn Miller, Nicolas Hengartner, Benjamin Migliori, Emily Casleton, Alexei Skurikhin, Earl Lawrence, Gerd J. Kunde
arXiv Statistics ML
Oct 28

Data-driven Discovery of Lie Symmetries and First Integrals with Latent ODEs

The paper introduces LatentLieODE, a neural ODE framework that learns linear Lie symmetries and first integrals from time‑series data such as videos. It uses an autoencoder to obtain a low‑dimensional latent space, fits linear infinitesimal generators to a Lie‑bracket residual, and trains a latent ODE to reconstruct observations. The method successfully identifies symmetries and conserved quantities in six benchmark systems, achieving high correlation with ground‑truth invariants and recovering a non‑abelian σ(3) algebra on the sphere.

By Matt L. Wiemman, Peter Melchior
arXiv Machine Learning
Oct 8

How Do Transformers Learn to Represent Symmetries?

The paper investigates how a vanilla Transformer learns symmetries from finite data augmentation on point cloud datasets. It finds an ordering of learnability: non-angle-preserving symmetries are easiest, followed by angle-preserving symmetries, and finally base angle-preserving subgroups such as translation, rotation, and scale. The study also examines the Transformer's extrapolation behavior, performs a structural analysis of trained models to uncover interpretable mechanisms for invariance, and extends these findings to equivariant functions, suggesting that the identified mechanisms can serve as building blocks for learned equivariance.

By Eduardo Santos-Escriche, Valerie Engelmayer, Ya-Wei Eileen Lin, Stefanie Jegelka
arXiv Machine Learning
Oct 12

Coordinate-Free Automatic Differentiation

The paper introduces a basis‑independent derivative operator that can represent a wide range of geometric differential operations, such as rotations, volume forms, and curvatures, without requiring explicit coordinate arrays. This operator is built solely from existing automatic differentiation primitives and can be composed with JAX’s batching, compilation, and hardware acceleration features. The authors demonstrate its reusability across manifold operators, its integration into a spacetime inverse‑problem pipeline, and its application to optimization over rotor subgroups.

By Alex Guerra, Joshua Aduol, Yaqian Tang, Daniel Williams, Ryan P. Adams, Peter Orbanz
arXiv AI
Jun 29

LieSolver: PDE-Constrained Learning for IBVPs via Lie Symmetries

arXiv:2510. 25731v2 Announce Type: replace-cross Abstract: Initial-boundary value problems (IBVPs) provide the essential framework for modelling a wide range of phenomena in physics and engineering.

By Ren\'e P. Klausen, Ivan Timofeev, Jonas Naujoks, Johannes Frank, Thomas Wiegand, Sebastian Lapuschkin, Wojciech Samek