arXiv Computer Vision

TrajCFG: Token-Wise Classifier-Free Guidance via Denoising Trajectory Feedback

TrajCFG introduces a training‑free, token‑wise adaptation of classifier‑free guidance for flow‑matching models, leveraging historical changes in guided velocity direction to assign bounded scales. By mapping directional feedback to stronger guidance for larger changes and weaker guidance for consistent directions, it fuses adjacent‑step and interval‑normalized longer‑span signals without extra model evaluations. Experiments across text‑to‑video, image‑to‑video, text‑to‑audio‑video, text‑to‑image, and image‑to‑3D tasks demonstrate consistent improvements over base samplers, notably raising VBench Total scores by 0.30‑0.75 points on three backbones for text‑to‑video generation.

arXiv Computer Vision
Sep 22

Classifier-Free Guidance in Flow Matching: Non-Autonomous Potentials, Overshoot, and Posterior-Mean Control

The paper studies classifier‑free guidance (CFG) in Flow Matching, showing that strong guidance can distort the generated distribution by shifting the mean and concentrating trajectories. By interpreting Flow Matching as a time‑varying gradient flow, the authors explain how CFG reshapes the underlying potential and propose a training‑free method, Posterior‑Mean‑Capped CFG (PMC‑CFG), that adaptively limits guidance to the strongest feasible level. Experiments on synthetic and large‑scale image‑generation tasks demonstrate that PMC‑CFG reduces distortion and concentration while improving the alignment–diversity trade‑off, especially when nominal guidance is large.

By Jishen Peng, Zheng Ma
arXiv Machine Learning
Jun 30

Momentum Guidance: Plug-and-Play Guidance for Flow Models

arXiv:2602. 20360v2 Announce Type: replace Abstract: Flow-based generative methods offer a simple and effective framework for high-fidelity generation, yet pretrained flow models are rarely used in their vanilla conditional form: in image generation, samples without guidance often appear diffuse and lack fine-grained detail.

By Runlong Liao, Jian Yu, Baiyu Su, Chi Zhang, Lizhang Chen, Qiang Liu
arXiv Machine Learning
Oct 7

Global Transport Couplings for Classifier-Free Guided Flows

The paper introduces Global Transport (GT), a class‑agnostic optimal‑transport coupling that can be computed without class labels. GT associates different conditions with distinct regions of the source noise, which degrades performance when used without guidance but consistently improves generation when combined with classifier‑free guidance across various domains, model scales, and sampling budgets. The authors argue that coupling design should be evaluated under guided flow conditions rather than unguided generation, and demonstrate GT’s benefits on both discrete class‑conditioned and continuous text‑conditioned image generation.

By Katarina Petrovi\'c, Zander W. Blasingame, Danyal Rehman, \.Ismail \.Ilkan Ceylan, Michael Bronstein, Stephen Y. Zhang, Lazar Atanackovic, Alexander Tong
arXiv Computer Vision
Oct 15

VITAL: From Visual Motion to Precise Action

arXiv:2610.20604v1 Announce Type: new Abstract: World-action models aim to turn visual anticipation into driving decisions, yet typically train action experts on trajectory representations defined in...

By Ao Liang, Youquan Liu, Mingxiao Li, Wei Chow, Lingdong Kong, Yue Liao, Dongyue Lu, Yu Yang, Wei Yin, Runnan Chen
arXiv Computer Vision
Oct 12

VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification

VideoAWR introduces a decoupled-timestep advantage‑weighted rectification framework for video flow models, separating guided rollouts from the optimization anchor to avoid geometric guidance blow‑up and cold‑start collapse. The method uses an EMA reference policy for guided rollouts while rectifying against an unguided conditional anchor, proving that the centered advantage cancels the anchor in expectation and retains only reward‑correlated covariance. Experiments on Wan2.1‑1.3B and 14B models show stable training and improved visual and motion quality in both CFG‑free and CFG‑enabled settings.

By Zheming Fu, Wenbin Ning, Ruizhe He, Wei Shang, Xiaoxiao Ma, Lianrui Mu, Chang Liu, Lei Wang, Siming Fu
arXiv Computer Vision
Sep 30

LongLive-Plug: Once-for-All Distillation for Video Generation

LongLive‑Plug is a once‑for‑all distillation framework that learns reusable LoRA adapters on a base video diffusion model, enabling training‑free, plug‑and‑play deployment to a wide range of downstream models. These adapters provide single‑pass classifier‑free guidance, few‑step sampling, and long‑context error correction for autoregressive generation, and remain effective even when downstream models add conditioning branches or expand output channels. The authors demonstrate that the approach works on 54 downstream models across three backbone families and eight task categories, including world modeling, robotics, editing, and multimodal generation.

By Shuai Yang, Luozhou Wang, Wei Huang, ZhiFei Chen, Bohan Zhang, Xiao Fu, Qianli Ma, Chen-Hsuan Lin, Weian Mao, Bryan Chu, Song Han, Yukang Chen
Hugging Face Trending Papers
Oct 5

MoCAR: Motion-code Coordinate-aware AutoRegression for Continuous Trajectory Forecasting

MoCAR (Motion-code Coordinate-aware AutoRegression) is a decoder‑only framework that treats continuous trajectory forecasting as next‑code prediction in a coordinate‑aware latent space. It learns a continuous motion‑code space from endpoint‑normalized trajectory segments, using historical codes as a teacher‑forced prefix and generating future codes autoregressively while updating local scene context. The method achieves top‑tier performance on Argoverse benchmarks, transfers well from AV2 to AV1 in zero‑shot evaluation, and improves on turn‑heavy scenarios without requiring trajectory‑space re‑tokenization or proposal‑and‑refinement pipelines.

arXiv Computer Vision
Sep 18

Latent-Centroid Steering: Single-Pass Classifier-Free Guidance for Command-Aligned Autonomous Driving

The paper introduces Latent-Centroid Steering (LCS), a single-pass classifier-free guidance method for vision‑language autonomous driving models. LCS replaces instance‑level residuals with class‑level latent shifts, projecting conditional representations toward precomputed command‑specific centroids to enhance command adherence. Experiments on Bench2Drive and nuScenes show that LCS cuts inference latency by about 50% while improving driving performance.

By Meibo Hu, Jiamian Wang, Pichao Wang, Zhiqiang Tao