arXiv Machine Learning

Learning symplectic model reduction based on an approximation theorem of symplectic embeddings

arXiv:2606. 04623v2 Announce Type: replace Abstract: High-dimensional Hamiltonian systems play a central role in many scientific and engineering disciplines, with dynamics that evolve on symplectic manifolds.

arXiv Machine Learning
Jun 26

Symplectic Neural Networks for learning Generalized Hamiltonians

arXiv:2606. 27029v1 Announce Type: new Abstract: Hamiltonian Neural Networks (HNNs) integrate physical priors into neural models by learning a system's Hamiltonian, improving generalization and sample efficiency.

By Harsh Choudhary, Vyacheslav Kungurtsev, Chandan Gupta, Melvin Leok, Georgios Korpas
arXiv Machine Learning
Aug 3

Symplectic Representation of Legendre Dynamics

arXiv:2512. 19409v2 Announce Type: replace Abstract: Modern learning systems act on internal representations of data, yet how these representations encode underlying physical or statistical structure is often left implicit.

By Robert Simon Fong, Gouhei Tanaka, Kazuyuki Aihara
arXiv Machine Learning
Jul 7

CSympNet-ID: conformal-symplectic map learning for linearly damped Hamiltonian systems

arXiv:2607. 03339v1 Announce Type: new Abstract: Learning dissipative dynamics from discrete observations is essential for reliable long-horizon prediction and physically meaningful parameter identification.

By Jiale Gong (School of Mathematics), Pengzhan Jin (National Engineering Laboratory for Big Data Analysis and Applications, Peking University, Beijing, China), Dongyang Kuang (School of Mathematics), Lu Li (School of Mathematics), Yifa Tang (State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China)
arXiv Machine Learning
Sep 17

Generalizing Adam to Manifolds for Efficiently Training Transformers

The paper introduces a novel generalization of the Adam optimizer to manifold settings, specifically targeting homogeneous spaces such as the Stiefel, symplectic Stiefel, and Grassmann manifolds. By exploiting a global tangent space representation (the Lie subspace), the authors eliminate the need for projection steps and enable all Adam operations to be performed directly on these manifolds. The new optimizer is applied to train transformers and a symplectic autoencoder, achieving orthogonality constraints to machine precision and outperforming existing methods.

By Benedikt Brantner