arXiv Computer Vision By Yang Zhao, Yan Zhang, Zixuan Guo, Hangyu Zhou, Haotian Mao, Hui Wang, Xubo Yang

IKMo: Image-Keyframed Motion Generation with Trajectory-Pose Conditioned Motion Diffusion Model

Read the original on arXiv Computer Vision →

The paper introduces TPMDM, a diffusion model that decouples and aligns heterogeneous geometric constraints—user-defined global trajectories and local image-derived poses—through a parallel control strategy. Building on TPMDM, the IKMo framework integrates a VLM-powered multi-agent system to translate user-friendly inputs into explicit motion constraints, enabling precise animation from unaligned, in-the-wild 2D reference images. Experiments on HumanML3D and KIT-ML show that IKMo achieves state‑of‑the‑art performance for motion generation under mixed trajectory and keyframe pose constraints.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computer Vision.