HarmoHOI: Harmonizing Appearance and 3D Motion for Multi-view Hand-Object Interaction Synthesis
arXiv:2607. 17097v2 Announce Type: replace Abstract: Hand-Object Interaction (HOI) synthesis is a cornerstone for animation production and embodied AI.
The paper introduces TPMDM, a diffusion model that decouples and aligns heterogeneous geometric constraints—user-defined global trajectories and local image-derived poses—through a parallel control strategy. Building on TPMDM, the IKMo framework integrates a VLM-powered multi-agent system to translate user-friendly inputs into explicit motion constraints, enabling precise animation from unaligned, in-the-wild 2D reference images. Experiments on HumanML3D and KIT-ML show that IKMo achieves state‑of‑the‑art performance for motion generation under mixed trajectory and keyframe pose constraints.
arXiv:2607. 17097v2 Announce Type: replace Abstract: Hand-Object Interaction (HOI) synthesis is a cornerstone for animation production and embodied AI.
arXiv:2607. 08741v1 Announce Type: cross Abstract: Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics.
arXiv:2608.23279v1 Announce Type: new Abstract: Text-driven human motion synthesis has made substantial development with two core modules of motion representation and generative architecture. For rep...
arXiv:2609.01059v1 Announce Type: new Abstract: As Vision-Language Models (VLMs) tackle dynamic 3D spatial reasoning, ego-motion perception becomes essential to resolve monocular scale ambiguity. How...
arXiv:2606. 02000v1 Announce Type: cross Abstract: Diffusion models have shown remarkable success in video generation.
arXiv:2610.01742v1 Announce Type: cross Abstract: Equipping artificial agents with spatial intelligence requires a comprehensive generative prior over the dynamic 3D world. We propose World Motion Mo...
arXiv:2603. 22282v2 Announce Type: replace-cross Abstract: We present UniMotion, to our knowledge the first unified framework for simultaneous understanding and generation of human motion, natural language, and RGB images within a single architecture.
The paper introduces Driving with DINO (DwD), a framework that uses Vision Foundation Module (VFM) features to bridge simulation and real-world domains for autonomous driving video generation. It addresses the consistency‑realism dilemma by projecting VFM features onto a principal subspace, dropping high‑frequency texture elements, and applying a Random Channel Tail Drop to preserve structural detail. Additional components— a learnable Spatial Alignment Module and a Causal Temporal Aggregator— enhance control precision, spatial alignment, and temporal stability, reducing motion blur and ensuring realistic, consistent outputs.
The paper introduces DSG‑GI, a method that adapts pretrained latent video diffusion models for generative inbetweening by using Destination‑Conditioned Adaptation and Semantic‑Geometric Alignment. Destination‑Conditioned Adaptation treats the target frame as the sequence’s endpoint, providing progressive guidance along the generated trajectory. Semantic‑Geometric Alignment aligns token‑wise spatio‑temporal geometry of backbone features with a frozen video encoder and enforces a flow‑matching latent flow constraint near the data endpoint, thereby improving temporal stability, target‑frame faithfulness, and perceptual quality on large‑motion benchmarks.
arXiv:2606. 07053v1 Announce Type: cross Abstract: Pose-guided text-to-image generation often suffers from limb distortions and feature crosstalk in complex multi-person scenarios.
arXiv:2607. 00832v1 Announce Type: cross Abstract: A single panorama captures the full visual sphere from one camera center, yet confines users to looking around in place without enabling true scene exploration.
ControlFlow3D is a framework that upsamples point clouds by distilling knowledge from pretrained foundation models into a lightweight generation network. It performs conditional flow matching in a latent space defined by a frozen 3D encoder, using unsupervised soft KMeans to cluster multi‑view image tokens and 3D latent tokens into shared prototypes that guide the flow trajectory. A Mamba‑based geometry decoder then maps latent features to dense coordinates with linear complexity, and the authors introduce ShapeNetPU, a 35K‑object multi‑modal benchmark 31 times larger than previous datasets.