arXiv Computer Vision

MotionMaestro: Masked Tokenization for Unified Motion Generation

arXiv Computer Vision
Aug 26

SeMoCo: A Semantic-First Motion Codec for Motion Language Modeling

arXiv:2608.24334v1 Announce Type: new Abstract: Discrete motion representations have substantially advanced autoregressive text-to-motion generation. However, most motion tokenizers are optimized for...

By Tianlv Huang, Hetian Guo, Ziyi Cai, Song Wang, Yanping Zhang, Zipei Fan, Xuan Song, Guangming Wu, Xin Zheng
arXiv Computer Vision
Sep 15

MoVT: Video-Augmented Motion Tokenizer for Text-to-Motion Generation

MoVT is a new framework for text‑to‑motion generation that uses a cross‑modal augmented motion tokenizer to project 3D motion tokens into 2D, enriching the motion codebook with real‑world video patterns. The enriched tokens are mapped back to 3D, creating aligned 3D and 2D codebooks that better capture intricate motions. These codebooks feed a generative masked transformer, which predicts masked motion tokens in a modality‑agnostic way, allowing text‑index pairs from the 2D codebook and annotated videos to further improve generation quality. Empirical tests show MoVT outperforms previous state‑of‑the‑art methods on several key metrics.

By Beibei Jing, Tianle Guo, Youjia Zhang, Zikai Song, Yawei Luo, Junqing Yu, Tao Guan, Wei Yang
arXiv Computer Vision
Oct 9

Controllable Exaggeration for Generative Motion Models via Training-Time Adaptation and Inference-Time Guidance

The paper introduces a two-stage framework to incorporate the animation principle of exaggeration into motion generative models. During training, it fine‑tunes pre‑trained text‑to‑motion models on a curated exaggeration dataset. At inference, it uses a mathematical formulation based on dynamic movement primitives to guide diffusion and flow‑matching models toward more expressive, exaggerated motions while maintaining physical plausibility and the original motion intent.

By Amirhossein Zamani, Arianna Rampini, Bruno Roy
arXiv Computer Vision
Oct 9

TKCAM: Text and Keyframe to Camera Trajectory Generation

TKCAM is a new framework for generating controllable camera motion conditioned on text and sparse keyframes, using a 12‑dimensional kinematic representation and a two‑stage masked transformer with residual vector quantization. It allows users to provide free‑form text prompts and RGB observations at selected timestamps, enabling temporally localized visual guidance for coherent trajectory synthesis. The authors also introduce the RealEstate10K‑Cap dataset and a Universal CLaTr Evaluator, showing that TKCAM outperforms recent baselines on FID, text‑motion matching, and retrieval metrics.

By Haozhe Yang, Zhiyang Dou, Zekai Gu, Cheng Lin, Wenping Wang, Yuan Liu, Taku Komura
arXiv AI
Sep 15

Open-UniMo: Towards Unified Motion-Language Understanding and Generation in the Open World

arXiv:2609.14615v1 Announce Type: cross Abstract: Unified motion generation and understanding is crucial for embodied AI systems that can both synthesize and interpret human actions in open-world env...

By Guocun Wang, Kenkun Liu, Guorui Song, Jing Lin, Zhe Huang, Luyuan Zhang, Dake Zhong, Choo Sin Wai, Xiaoguang Han, Haoqian Wang
arXiv Computer Vision
6d ago

FlashMotion: Ultra-Fast Long-Term 3D Motion Generation

FlashMotion is a new framework for generating high‑quality, long‑horizon 3D human motion quickly enough for real‑time interactive use. It combines a 3D motion‑space MeanFlow formulation with adaptive soft masking for efficient few‑step generation, and a lightweight non‑autoregressive BiMamba architecture that improves per‑step speed while maintaining cross‑modal alignment. Experiments show state‑of‑the‑art performance on text‑to‑motion, music‑to‑dance, and speech‑to‑gesture tasks, with code released publicly.

By Kaixing Yang, Xulong Tang, Ronghui Li, Xiangyue Zhang, Ziqiao Peng, Mingshuang Luo, Chenxi Zhao, Haoyu Wu, Ju Fan, Hongyan Liu, Puwei Wang, Zijiao Zeng, Jun He
arXiv Computer Vision
Oct 12

Linear Multi-granular Body Modeling for Text-Driven Motion Generation

Linear Multi-granular Body Modeling for Text-Driven Motion Generation proposes HiSTF Mamba, a linear-time framework that combines Dual‑Spatial Mamba, Bi‑Temporal Mamba, and a Dynamic Spatiotemporal Fusion Module to model both part‑level and whole‑body dynamics. The approach captures local joint dynamics and global coordination in parallel, encodes short‑term and long‑term motion details bidirectionally, and removes redundant features to produce an expressive spatiotemporal representation. Experiments on HumanML3D and KIT‑ML show that HiSTF Mamba achieves higher generation fidelity and semantic alignment while using far fewer parameters than existing segment‑based architectures.

By Xingzu Zhan, Genpei Zhang, Chen Xie, Honghang Chen, Haoran Sun, Xiaochun Mai