arXiv Computer Vision

DuoMatching: Joint-Marginal Distribution Matching for Few-Step Video Generation

DuoMatching is a new framework for few-step video generation that extends distribution matching distillation by adding a joint‑marginal formulation. It introduces a marginal matching objective that uses an image generator to provide frame‑level supervision, and employs LatentBridge to align latent representations between the video student and image teacher. Latent Variation Sampling distributes this supervision across temporal segments, improving visual quality, composition, and semantic alignment while preserving motion dynamics, with human evaluations favoring it over baselines.

arXiv Computer Vision
Sep 25

ViRDM: Taming Representation Distribution Matching for Few-Step Causal Video Generation

ViRDM is a new post‑training method for few‑step causal video generation that eliminates the need for a large teacher model and an online critic. By applying representation distribution matching (RDM) with a precomputed target distribution, a lightweight VAE decoder, and staged vector–Jacobian products, ViRDM overcomes memory, optimization, and temporal dynamics challenges. The approach reduces GPU memory usage and training time, achieving state‑of‑the‑art VBench performance with only 20 generator updates and 16 A100 GPU‑hours.

By Zichong Meng, Chongjian Ge, Chun-Hao P. Huang, Yang Zhou, Huaizu Jiang
arXiv AI
Oct 2

Video Generation Models: A Survey of Post-Training and Alignment

arXiv:2610.00812v1 Announce Type: cross Abstract: Video generation has rapidly progressed from short, low-quality clips to high-resolution, long-duration sequences with complex spatiotemporal dynamic...

By Chaoyu Li, Xiaoyi Gu, Yogesh Kulkarni, Eun Woo Im, Mohammadmahdi Honarmand, Zeyu Wang, Juntong Song, Fei Du, Xilin Jiang, Kexin Zheng, Tianzhi Li, Fei Tao, Pooyan Fazli
arXiv Machine Learning
3d ago

Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matching

The paper introduces FreeMatching, a framework that moves beyond traditional spatio-temporal priors for dense correspondence matching. It combines generative and semantic representations with diverse supervision sources, and uses teacher‑guided refinement to improve identity‑preserving correspondence in image editing and reference‑guided generation tasks. Experiments show that a single FreeMatching model outperforms existing methods on challenging image pairs while maintaining strong performance on classical benchmarks, and its scores correlate with human judgment of identity preservation.

By Luping Liu, Bingyi Kang, Yifan Wang, Dong Xu
Hugging Face Trending Papers
Aug 27

LiveVVT: High-Fidelity Video Virtual Try-On in Real Time

LiveVVT introduces a rolling streaming diffusion framework for video virtual try‑on that maintains high visual fidelity while enabling real‑time performance. By confining bidirectional spatio‑temporal modeling to a fixed‑size window and using bounded temporal and global appearance memories, it emits clean video chunks with low latency. A progressive distillation pipeline further refines the model, achieving superior quality with 26× lower latency and 11× higher throughput compared to prior methods.

arXiv Computer Vision
Sep 7

Joint Alignment and Distillation for Video Generation via Sample-Guided Distribution Matching

The paper introduces DM-Align, a single-stage optimization framework that jointly performs distribution matching for distillation and aligns video generative models with human preferences. By deriving complementary gradient directions—one minimizing the gap between real and fake models and another guiding the model toward preferred samples—the method eliminates the need for separate reinforcement learning and distillation stages. Experiments on multiple foundational video models show that this sample-guided approach consistently outperforms both standalone variants and traditional two-stage pipelines.

By Jiuzhou Lin, Junlong Wu, Fei Zuo, Huan Ouyang, Dewen Fan, Boheng Zhang, Huaiqing Wang, Jia Sun, Fan Yang, Houde Liu, Kehai Chen, Min Zhang, Tingting Gao, Han Li
Hugging Face Trending Papers
Aug 13

V-RAE: Rethinking Video Latent Spaces for Generation

Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization.