arXiv:2412.00112v5 Announce Type: replace
Abstract: Generating natural and expressive human motions from textual descriptions is challenging due to the complexity of coordinating full-body dynamics a...
By Seong-Eun Hong, Soobin Lim, Juyeong Hwang, Minwook Chang, Hyeongyeop Kang
arXiv:2608.24334v1 Announce Type: new
Abstract: Discrete motion representations have substantially advanced autoregressive text-to-motion generation. However, most motion tokenizers are optimized for...
By Tianlv Huang, Hetian Guo, Ziyi Cai, Song Wang, Yanping Zhang, Zipei Fan, Xuan Song, Guangming Wu, Xin Zheng
MoVT is a new framework for text‑to‑motion generation that uses a cross‑modal augmented motion tokenizer to project 3D motion tokens into 2D, enriching the motion codebook with real‑world video patterns. The enriched tokens are mapped back to 3D, creating aligned 3D and 2D codebooks that better capture intricate motions. These codebooks feed a generative masked transformer, which predicts masked motion tokens in a modality‑agnostic way, allowing text‑index pairs from the 2D codebook and annotated videos to further improve generation quality. Empirical tests show MoVT outperforms previous state‑of‑the‑art methods on several key metrics.
By Beibei Jing, Tianle Guo, Youjia Zhang, Zikai Song, Yawei Luo, Junqing Yu, Tao Guan, Wei Yang
arXiv:2608.23279v1 Announce Type: new
Abstract: Text-driven human motion synthesis has made substantial development with two core modules of motion representation and generative architecture. For rep...
By Chengqun Yang, Liang Xu, Yanping Li, Fulong Liu, Jingnan Gao, Weili Zeng, Yichao Yan
arXiv:2607. 08741v1 Announce Type: cross Abstract: Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics.
By Kaifeng Zhao, Mathis Petrovich, Haotian Zhang, Tingwu Wang, Siyu Tang, Davis Rempe
arXiv:2603.08590v4 Announce Type: replace
Abstract: Text-to-motion generation has advanced with larger corpora and stronger generators, yet many models still rely on holistic frame- or clip-level lat...
By Zeyu Ling, Qing Shuai, Teng Zhang, Shiyang Li, Bo Han, Changqing Zou
The paper introduces a two-stage framework to incorporate the animation principle of exaggeration into motion generative models. During training, it fine‑tunes pre‑trained text‑to‑motion models on a curated exaggeration dataset. At inference, it uses a mathematical formulation based on dynamic movement primitives to guide diffusion and flow‑matching models toward more expressive, exaggerated motions while maintaining physical plausibility and the original motion intent.
By Amirhossein Zamani, Arianna Rampini, Bruno Roy
Generating high-quality and controllable camera motion is essential for AI-assisted cinematography, video synthesis, and 3D scene understanding. We introduce TKCAM, a Text- and Keyframe-conditioned CA...
TKCAM is a new framework for generating controllable camera motion conditioned on text and sparse keyframes, using a 12‑dimensional kinematic representation and a two‑stage masked transformer with residual vector quantization. It allows users to provide free‑form text prompts and RGB observations at selected timestamps, enabling temporally localized visual guidance for coherent trajectory synthesis. The authors also introduce the RealEstate10K‑Cap dataset and a Universal CLaTr Evaluator, showing that TKCAM outperforms recent baselines on FID, text‑motion matching, and retrieval metrics.
By Haozhe Yang, Zhiyang Dou, Zekai Gu, Cheng Lin, Wenping Wang, Yuan Liu, Taku Komura
arXiv:2609.14615v1 Announce Type: cross
Abstract: Unified motion generation and understanding is crucial for embodied AI systems that can both synthesize and interpret human actions in open-world env...
By Guocun Wang, Kenkun Liu, Guorui Song, Jing Lin, Zhe Huang, Luyuan Zhang, Dake Zhong, Choo Sin Wai, Xiaoguang Han, Haoqian Wang
FlashMotion is a new framework for generating high‑quality, long‑horizon 3D human motion quickly enough for real‑time interactive use. It combines a 3D motion‑space MeanFlow formulation with adaptive soft masking for efficient few‑step generation, and a lightweight non‑autoregressive BiMamba architecture that improves per‑step speed while maintaining cross‑modal alignment. Experiments show state‑of‑the‑art performance on text‑to‑motion, music‑to‑dance, and speech‑to‑gesture tasks, with code released publicly.
By Kaixing Yang, Xulong Tang, Ronghui Li, Xiangyue Zhang, Ziqiao Peng, Mingshuang Luo, Chenxi Zhao, Haoyu Wu, Ju Fan, Hongyan Liu, Puwei Wang, Zijiao Zeng, Jun He
Linear Multi-granular Body Modeling for Text-Driven Motion Generation proposes HiSTF Mamba, a linear-time framework that combines Dual‑Spatial Mamba, Bi‑Temporal Mamba, and a Dynamic Spatiotemporal Fusion Module to model both part‑level and whole‑body dynamics. The approach captures local joint dynamics and global coordination in parallel, encodes short‑term and long‑term motion details bidirectionally, and removes redundant features to produce an expressive spatiotemporal representation. Experiments on HumanML3D and KIT‑ML show that HiSTF Mamba achieves higher generation fidelity and semantic alignment while using far fewer parameters than existing segment‑based architectures.
By Xingzu Zhan, Genpei Zhang, Chen Xie, Honghang Chen, Haoran Sun, Xiaochun Mai