arXiv Computer Vision

VISTA: Video-Injected Stylized Text-to-Animation

arXiv Machine Learning
Aug 19

From Diffusion to Flow: Efficient Motion Generation in MotionGPT3

The paper compares diffusion and rectified flow objectives within the MotionGPT3 framework for text-driven motion generation. Experiments on HumanML3D show that rectified flow converges faster, achieves strong test performance earlier, and matches or exceeds diffusion quality while requiring fewer sampling steps. The study isolates the generative objective’s impact, demonstrating that rectified flow’s benefits transfer to continuous-latent motion generation.

By Jaymin Bhan, JiHong Jeon, SangYeop Jeong
arXiv Computer Vision
Sep 7

STyMo: Fast and Controllable Few-Shot Motion Style Transfer

STyMo is a few‑shot motion style transfer method that learns from only seconds of paired data and trains in one to two minutes. It decomposes style into a static posture component and a temporal dynamics component, allowing runtime adjustment of posture intensity, temporal exaggeration, and per‑body‑region style. The approach includes a stylizability gate to avoid artifacts on out‑of‑distribution motions and supports an iterative authoring workflow, with results shown across a range of motion styles and a released dataset for future research.

By Jose Luis Ponton, Alexander Winkler, Ladislav Kavan, Yuting Ye, Petr Kadlecek
Hugging Face Trending Papers
Aug 10

UniMoFlow: Grounding Instruction-Driven 3D Human Motion Editing in Generation

Instruction-driven editing of 3D human motion requires precise spatiotemporal localization, rich semantic grounding, and strict preservation of unmodified content. Existing methods either resort to training-free adaptation of generative models or rely solely on triplet supervision; however, adaptation often yields suboptimal control, and manually curated triplet datasets remain severely limited in scale and semantic diversity.

arXiv Computer Vision
Sep 15

MoVT: Video-Augmented Motion Tokenizer for Text-to-Motion Generation

MoVT is a new framework for text‑to‑motion generation that uses a cross‑modal augmented motion tokenizer to project 3D motion tokens into 2D, enriching the motion codebook with real‑world video patterns. The enriched tokens are mapped back to 3D, creating aligned 3D and 2D codebooks that better capture intricate motions. These codebooks feed a generative masked transformer, which predicts masked motion tokens in a modality‑agnostic way, allowing text‑index pairs from the 2D codebook and annotated videos to further improve generation quality. Empirical tests show MoVT outperforms previous state‑of‑the‑art methods on several key metrics.

By Beibei Jing, Tianle Guo, Youjia Zhang, Zikai Song, Yawei Luo, Junqing Yu, Tao Guan, Wei Yang
arXiv Computer Vision
Aug 26

Layer-Aware Video Composition via Split-then-Merge

The paper introduces Split-then-Merge (StM), a new framework for generative video composition that improves control and tackles data scarcity. StM divides a large set of unlabeled videos into dynamic foreground and background layers, then self‑composes them to learn how subjects interact with varied scenes. The method employs a transformation‑aware training pipeline with multi‑layer fusion, augmentation, and an identity‑preservation loss, achieving superior performance over state‑of‑the‑art methods in both quantitative and qualitative evaluations.

By Ozgur Kara, Yujia Chen, Ming-Hsuan Yang, James M. Rehg, Wen-Sheng Chu, Du Tran
arXiv AI
Jul 7

Motion Attribution for Video Generation

arXiv:2601. 08828v2 Announce Type: replace-cross Abstract: Despite the rapid progress of video generation models, the role of data in influencing motion is poorly understood.

By Xindi Wu, Despoina Paschalidou, Jun Gao, Antonio Torralba, Laura Leal-Taix\'e, Olga Russakovsky, Sanja Fidler, Jonathan Lorraine
Hugging Face Trending Papers
Jun 29

OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Data

Music-driven dance video generation aims to synthesize expressive human motion that is temporally aligned with music while maintaining high visual fidelity. Despite recent progress, existing methods still face two key limitations: the lack of large-scale, high-quality dance video datasets, and the absence of principled frameworks for integrating music as a complementary conditioning signal into Video Generation Foundation Models.

arXiv Computer Vision
Aug 26

SeMoCo: A Semantic-First Motion Codec for Motion Language Modeling

arXiv:2608.24334v1 Announce Type: new Abstract: Discrete motion representations have substantially advanced autoregressive text-to-motion generation. However, most motion tokenizers are optimized for...

By Tianlv Huang, Hetian Guo, Ziyi Cai, Song Wang, Yanping Zhang, Zipei Fan, Xuan Song, Guangming Wu, Xin Zheng