arXiv Statistics ML

Roto-translated Local Coordinate Frames For Interacting Dynamical Systems

The paper introduces local coordinate frames for each node in geometric graphs to enforce roto‑translation (Galilean) invariance in modeling interacting dynamical systems. By aligning each node’s frame with its local geometry, the method enables anisotropic filtering in graph neural networks and improves learning of highly non‑linear, time‑dependent behaviors. Experiments on traffic scenes, 3D motion capture, and colliding particles show that this approach outperforms recent state‑of‑the‑art methods.

arXiv Machine Learning
Oct 9

Exact SO(3)-Equivariant Isotropic Kernels for Rotation-Robust Neural Dynamics

The paper introduces the Invariant-Conditioned Isotropic Kernel Neural Operator (IKNO), a compact graph model designed to predict vector-valued partial differential equations in a rotation‑robust manner. IKNO constructs local interactions from rotation‑invariant scalar quantities and vector directions that transform consistently with the data, ensuring that rotating input positions and velocities results in a correspondingly rotated predicted velocity change. Experiments on three‑dimensional Navier–Stokes dynamics show that IKNO achieves numerical precision consistency, matches the forecasting accuracy of a larger rotation‑aware Tensor Field Network, and outperforms a parameter‑matched graph simulator.

By Ridham Patel
arXiv AI
Sep 7

What Moves? Localized Motion Representations for Compositional Scene Control

The paper introduces a promptable localized motion representation that generates persistent embeddings for user-specified regions in a video, without cropping or masking the input. By conditioning motion encoding directly on spatial masks while processing the full video, the method produces temporally consistent, region-addressable embeddings that capture local dynamics while preserving global context. These embeddings enable object-level motion transfer for dynamic scene composition and improve localized action classification in multi-actor videos, outperforming global representations that rely on cropping or post-hoc masking.

By Frank Fundel, Malek Ben Alaya, Thomas Ressler-Antal, Stefan Andreas Baumann, Bj\"orn Ommer
arXiv Machine Learning
Oct 22

Motion Equivariant Convolutional LSTM: When Motion Becomes a Gauge Symmetry

The paper introduces the Motion Equivariant Convolutional LSTM (MELSTM), a neural network that treats motion as a gauge symmetry and is equivariant to any motion, including time‑varying velocities. MELSTM extends previous flow‑equivariant recurrent networks by moving from simple recurrent units to convolutional LSTMs, allowing velocity estimation rather than enumeration. Experiments on future‑frame prediction, motion‑only digit classification, and action recognition with camera shake show that MELSTM outperforms both standard convolutional LSTMs and flow‑equivariant counterparts while using fewer parameters and generalizing to longer horizons and unseen motions.

By Vahid Hosseinzadeh, T. Anderson Keller, Michael Puthawala