arXiv Machine Learning By Ilker Gurcan, Kadir Ustun, Ramazan Gokberk Cinbis

Data-driven discovery of intrinsic Lie point symmetries of differential equation systems

Read the original on arXiv Machine Learning →

The paper presents a data-driven method for discovering intrinsic Lie point symmetries of differential equation systems directly from sampled jet-space data. By formulating symmetry discovery as an operator-theoretic problem, the approach identifies admissible generators, separates them from redundant or trivial directions, and reconstructs the full symmetry algebra, including its Lie-bracket structure, on benchmark systems. The method demonstrates that explicit continuous-symmetry generators can be recovered from data generated by both exact and approximate differential systems.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Aug 27

Loss Landscape Geometry of Partial Differential Equation Emulators: Or, Symmetry Learning via Gradient Alignment

The paper introduces a diagnostic tool that measures how neural emulators of partial differential equations capture physical symmetries by evaluating the overlap of loss gradients along symmetry-related states. This metric probes the local geometry of the learned loss landscape and goes beyond traditional equivariance tests by directly assessing learning dynamics. Applied to autoregressive fluid flow emulators, the study shows that orbit-wise gradient coherence enables generalization over symmetry transformations and reveals when training selects a symmetry-compatible basin.

By James Amarel, Robyn Miller, Nicolas Hengartner, Benjamin Migliori, Emily Casleton, Alexei Skurikhin, Earl Lawrence, Gerd J. Kunde
arXiv Statistics ML
Oct 28

Data-driven Discovery of Lie Symmetries and First Integrals with Latent ODEs

The paper introduces LatentLieODE, a neural ODE framework that learns linear Lie symmetries and first integrals from time‑series data such as videos. It uses an autoencoder to obtain a low‑dimensional latent space, fits linear infinitesimal generators to a Lie‑bracket residual, and trains a latent ODE to reconstruct observations. The method successfully identifies symmetries and conserved quantities in six benchmark systems, achieving high correlation with ground‑truth invariants and recovering a non‑abelian σ(3) algebra on the sphere.

By Matt L. Wiemman, Peter Melchior
arXiv Machine Learning
Oct 8

How Do Transformers Learn to Represent Symmetries?

The paper investigates how a vanilla Transformer learns symmetries from finite data augmentation on point cloud datasets. It finds an ordering of learnability: non-angle-preserving symmetries are easiest, followed by angle-preserving symmetries, and finally base angle-preserving subgroups such as translation, rotation, and scale. The study also examines the Transformer's extrapolation behavior, performs a structural analysis of trained models to uncover interpretable mechanisms for invariance, and extends these findings to equivariant functions, suggesting that the identified mechanisms can serve as building blocks for learned equivariance.

By Eduardo Santos-Escriche, Valerie Engelmayer, Ya-Wei Eileen Lin, Stefanie Jegelka