arXiv Machine Learning

Flexible Motion Generation from Language and Style References

arXiv Computer Vision
Oct 9

Controllable Exaggeration for Generative Motion Models via Training-Time Adaptation and Inference-Time Guidance

The paper introduces a two-stage framework to incorporate the animation principle of exaggeration into motion generative models. During training, it fine‑tunes pre‑trained text‑to‑motion models on a curated exaggeration dataset. At inference, it uses a mathematical formulation based on dynamic movement primitives to guide diffusion and flow‑matching models toward more expressive, exaggerated motions while maintaining physical plausibility and the original motion intent.

By Amirhossein Zamani, Arianna Rampini, Bruno Roy
arXiv Computer Vision
Sep 28

Motion Style Slider: Endpoint-Supervised Continuous Style Control for Human Motion Diffusion

The paper introduces Motion Style Slider, a framework that enables continuous, endpoint‑supervised control of style intensity in human motion diffusion. By constructing a style direction in a learned motion‑style embedding space and conditioning diffusion generation with a scalar intensity, the method achieves smooth, monotonic style scaling without needing intermediate‑intensity ground truth. The approach is compatible with pretrained diffusion backbones, supports heterogeneous style datasets, and is evaluated on controllability, interpolation/extrapolation, content preservation, and motion realism.

By Chen-Chieh Liao, Yichen Peng, Yiyi Cai, Y\^ui Ono, Hiroki Hanaoka, Erwin Wu, Hideki Koike, Shuichi Kurabayashi
arXiv Computer Vision
Oct 12

ELMA: Benchmarking Anaphoric Compositions for Long-Term Text-to-Motion Generation

The paper introduces ELMA, a new episodic long‑term motion dataset designed to benchmark anaphoric compositions in text‑to‑motion generation. ELMA contains densely annotated 30‑second clips extracted from in‑the‑wild videos, preserving cross‑segment dependencies that current models struggle to handle. Fine‑tuning state‑of‑the‑art models on ELMA improves both global physical realism and semantic alignment, establishing a robust baseline for long‑term motion synthesis.

By Shun Kato, Dixin Yang, Kotaro Amaya, Yuiga Wada, Kazumi Fukuda, Takashi Shibuya, Yuki Mitsufuji, Mariko Isogawa
arXiv Computer Vision
Sep 7

STyMo: Fast and Controllable Few-Shot Motion Style Transfer

STyMo is a few‑shot motion style transfer method that learns from only seconds of paired data and trains in one to two minutes. It decomposes style into a static posture component and a temporal dynamics component, allowing runtime adjustment of posture intensity, temporal exaggeration, and per‑body‑region style. The approach includes a stylizability gate to avoid artifacts on out‑of‑distribution motions and supports an iterative authoring workflow, with results shown across a range of motion styles and a released dataset for future research.

By Jose Luis Ponton, Alexander Winkler, Ladislav Kavan, Yuting Ye, Petr Kadlecek
arXiv Computer Vision
Oct 21

Learn to Modify: Self-evolving Multi-agent Refinement Framework for Conversational Text-to-Motion Generation

The paper introduces SMART, a Self‑evolving Multi‑Agent Refinement Framework for conversational text‑to‑motion generation. It enables users to iteratively refine specific spatio‑temporal regions of a motion sequence based on natural language feedback, preserving the rest of the motion. The framework incorporates a semantic‑guided masked editing mechanism and a memory‑based self‑evolving strategy to reuse past editing knowledge and reduce redundant exploration.

By Jianan Li, Jiawei Zhao, Yangtao Zhou, Zhifu Zhao, Shaoxin Wu, Yutao Wang, Dezhen Wang, Hua Chu, Fu Li
Hugging Face Trending Papers
Sep 28

BiMoGen: Bidirectional Motion-Text Generation via Unified Masked Discrete Diffusion

BiMoGen introduces a unified masked discrete diffusion framework for bidirectional motion‑text generation, addressing the limitations of autoregressive models in capturing bidirectional dependencies between language and motion. The approach employs a two‑stage training strategy—decoupled uni‑ and cross‑modal pretraining followed by supervised fine‑tuning—to establish robust cross‑modal correspondence, and incorporates Generation‑Aware Self‑Correction to mitigate error propagation during inference. Experiments on HumanML3D and KIT‑ML show competitive performance on both text‑to‑motion and motion‑to‑text tasks, demonstrating the effectiveness of the proposed training and correction mechanisms.

arXiv AI
Jul 7

Motion Attribution for Video Generation

arXiv:2601. 08828v2 Announce Type: replace-cross Abstract: Despite the rapid progress of video generation models, the role of data in influencing motion is poorly understood.

By Xindi Wu, Despoina Paschalidou, Jun Gao, Antonio Torralba, Laura Leal-Taix\'e, Olga Russakovsky, Sanja Fidler, Jonathan Lorraine