arXiv AI

Discovering Phase Space Structure in Learned Hamiltonian Systems

The paper introduces Structured Phase Space GAN (SPS‑GAN), a conditional generative model that learns structured dynamics from Cartesian trajectories and video. SPS‑GAN integrates a port‑Hamiltonian backbone with adversarial conditional generation, enabling representation of conservative, dissipative, and forced systems within a single architecture. Using a cyclic‑coordinate loss, the model recovers system degrees of freedom and canonical coordinates from raw observations, achieving better trajectory accuracy than supervised dynamics baselines and improved video consistency over generative baselines while consistently identifying correct latent mechanical coordinates.

arXiv AI
2d ago

Generative AI for Autonomous Driving: A Review

arXiv:2505.15863v2 Announce Type: replace-cross Abstract: Generative AI (GenAI) is rapidly advancing the field of Autonomous Driving (AD), extending beyond traditional applications in text, image, an...

By Katharina Winter, Abhishek Vivekanandan, Rupert Polley, Yinzhe Shen, Christian Schlauch, Mohamed-Khalil Bouzidi, Bojan Derajic, Natalie Grabowsky, Annajoyce Mariani, Dennis Rochau, Giovanni Lucente, Harsh Yadav, Firas Mualla, Adam Molin, Sebastian Bernhard, Christian Wirth, \"Omer \c{S}ahin Ta\c{s}, Nadja Klein, Fabian B. Flohr, Hanno Gottschalk
arXiv AI
Oct 2

Evaluating Physical Consistency and Plausibility in Generative Scenario Models for Autonomous Driving

The paper introduces a layered evaluation protocol for generative scenario models used in autonomous driving, focusing on physical consistency and plausibility. It examines internal representations through kinematic alignment, statistical baseline comparison, latent controllability, and activation analysis, and then tests outputs against vehicle dynamics constraints such as lateral jerk thresholds. The protocol is applied to a VAE-based scenario generator and other generative models, revealing deeper insights than standard output-level metrics.

By Manasa Mariam Mammen, Zafer Kayatas, Stefan Wagner
arXiv AI
Sep 17

Walking the Score Manifold: Continuous-time Generative Dynamics on Learned Data Manifolds

The paper proposes a continuous‑time generative framework that models time‑dependent data as evolution on a learned data manifold. By using pretrained score‑based models as geometric priors, it learns a vector field that drives data along score‑induced interpolation paths, enabling generation at arbitrary timestamps and temporal super‑resolution. The method includes a regression‑based training objective, a stability‑promoting term interpreted as denoising score matching, and a probabilistic extension for future trajectory distributions, demonstrated on natural video, PDE‑based fields, and molecular dynamics.

By Jan Tauberschmidt, Brian B. Moser, Stanislav Frolov, Andreas Dengel, Andrew B. Duncan, Sebastian J. Vollmer
arXiv Computer Vision
Oct 8

Video-Conditioned Generative Joint 2D-3D Hand Motion Recovery

The paper introduces JoHan, a generative framework that directly recovers 2D and 3D hand motion from video sequences without intermediate per‑frame pose predictions. By jointly learning temporal dynamics and 2D‑3D correspondence, JoHan generates aligned pose sequences that improve temporal consistency and enable accurate estimation of the hand’s global position and orientation relative to the camera. Experiments on challenging benchmarks show that JoHan achieves higher accuracy and faster performance, producing smoother hand‑motion dynamics while maintaining high per‑frame pose accuracy.

By Chen Xu, Yunqi Li, Binbin Huang, Brent Yi, Shenghua Gao, Yi Ma
arXiv Machine Learning
Sep 4

Data-efficient Kernel Methods for Learning Hamiltonian Systems

The paper introduces kernel-based methods for learning Hamiltonian systems directly from trajectory data, offering both a 2‑step approach (reconstruct trajectories first, then learn the Hamiltonian) and a 1‑step approach (joint inference). Experiments on mass‑spring dynamics, a nonlinear pendulum, and the Henon‑Heiles system show that the methods achieve accurate, data‑efficient predictions, outperforming 2‑step baselines especially when data are scarce, while preserving the Hamiltonian structure. The authors also provide a priori error estimates and a general numerical framework applicable to arbitrary dynamical systems.

By Yasamin Jalalian, Mostafa Samir, Boumediene Hamzi, Peyman Tavallali, Houman Owhadi