arXiv Machine Learning

Flow Matching with Uncertainty Quantification and Guidance

arXiv Machine Learning
Jun 30

Momentum Guidance: Plug-and-Play Guidance for Flow Models

arXiv:2602. 20360v2 Announce Type: replace Abstract: Flow-based generative methods offer a simple and effective framework for high-fidelity generation, yet pretrained flow models are rarely used in their vanilla conditional form: in image generation, samples without guidance often appear diffuse and lack fine-grained detail.

By Runlong Liao, Jian Yu, Baiyu Su, Chi Zhang, Lizhang Chen, Qiang Liu
arXiv Machine Learning
Jun 17

Uncertainty Quantification for Flow-Based Vision-Language-Action Models

arXiv:2606. 18043v1 Announce Type: cross Abstract: Vision-language-action models (VLAs) combine vision-language backbones with expressive generative action heads trained via flow matching on large-scale robotic datasets.

By Ralf R\"omer, Maximilian Seeliger, Saida Liu, Ben Sturgis, Marco Bagatella, Daniel Marta, Andreas Krause, Angela P. Schoellig
arXiv AI
Sep 2

Training-Free Refinement of Flow Matching with Divergence-based Sampling

The paper introduces Flow Divergence Sampler (FDS), a training‑free method that refines intermediate states in flow‑matching models by using the divergence of the marginal velocity field to detect and correct misguidance toward low‑density regions. FDS operates during inference, requires no additional training, and can be applied as a plug‑and‑play module with standard solvers and existing flow backbones. Experiments show that FDS consistently improves fidelity in tasks such as text‑to‑image synthesis and inverse problems.

By Yeonwoo Cha, Jaehoon Yoo, Semin Kim, Yunseo Park, Jinhyeon Kwon, Seunghoon Hong
Hugging Face Trending Papers
Jun 16

Uncertainty Quantification for Flow-Based Vision-Language-Action Models

Vision-language-action models (VLAs) combine vision-language backbones with expressive generative action heads trained via flow matching on large-scale robotic datasets. Despite their strong empirical performance in robotic manipulation, VLAs lack mechanisms to quantify confidence in their predictions and to detect when their actions may be unreliable.

arXiv Computer Vision
Sep 22

Classifier-Free Guidance in Flow Matching: Non-Autonomous Potentials, Overshoot, and Posterior-Mean Control

The paper studies classifier‑free guidance (CFG) in Flow Matching, showing that strong guidance can distort the generated distribution by shifting the mean and concentrating trajectories. By interpreting Flow Matching as a time‑varying gradient flow, the authors explain how CFG reshapes the underlying potential and propose a training‑free method, Posterior‑Mean‑Capped CFG (PMC‑CFG), that adaptively limits guidance to the strongest feasible level. Experiments on synthetic and large‑scale image‑generation tasks demonstrate that PMC‑CFG reduces distortion and concentration while improving the alignment–diversity trade‑off, especially when nominal guidance is large.

By Jishen Peng, Zheng Ma
arXiv Machine Learning
Oct 7

Global Transport Couplings for Classifier-Free Guided Flows

The paper introduces Global Transport (GT), a class‑agnostic optimal‑transport coupling that can be computed without class labels. GT associates different conditions with distinct regions of the source noise, which degrades performance when used without guidance but consistently improves generation when combined with classifier‑free guidance across various domains, model scales, and sampling budgets. The authors argue that coupling design should be evaluated under guided flow conditions rather than unguided generation, and demonstrate GT’s benefits on both discrete class‑conditioned and continuous text‑conditioned image generation.

By Katarina Petrovi\'c, Zander W. Blasingame, Danyal Rehman, \.Ismail \.Ilkan Ceylan, Michael Bronstein, Stephen Y. Zhang, Lazar Atanackovic, Alexander Tong
Hugging Face Trending Papers
Jul 13

Self-Consistent Flow: Unifying Velocity and Endpoint Prediction for Rectified Flow Models

In rectified-flow-based generative models, the neural network can be trained to predict two different targets, such as the instantaneous velocity or the data endpoint, to perform denoising. Although prior work shows that these parameterizations lead to different empirical behaviors, the mechanisms underlying their respective advantages remain to be underexplored, and how to combine them effectively is still unclear.

arXiv AI
Aug 12

Flow Straight to Reality: Perceptually Consistent Flow Matching for Efficient Image Restoration

arXiv:2608. 10544v1 Announce Type: cross Abstract: Image restoration is fundamentally constrained by the tradeoff between distortion and perception: minimizing pixel-wise error yields over-smoothed results, whereas optimizing for perceptual realism often introduces structural deviations.

By Sangwoo Jo, Donggeun Ko, Jayeon Kang, Youngsang Kwak, Jaehwa Kwak, Sungjoon Choi
arXiv Computer Vision
Oct 23

TrajCFG: Token-Wise Classifier-Free Guidance via Denoising Trajectory Feedback

TrajCFG introduces a training‑free, token‑wise adaptation of classifier‑free guidance for flow‑matching models, leveraging historical changes in guided velocity direction to assign bounded scales. By mapping directional feedback to stronger guidance for larger changes and weaker guidance for consistent directions, it fuses adjacent‑step and interval‑normalized longer‑span signals without extra model evaluations. Experiments across text‑to‑video, image‑to‑video, text‑to‑audio‑video, text‑to‑image, and image‑to‑3D tasks demonstrate consistent improvements over base samplers, notably raising VBench Total scores by 0.30‑0.75 points on three backbones for text‑to‑video generation.

By Jingyu Liu, Hao Jiang, Yikang Ding, Huafeng Shi, Xu Yang, Xiaoqiang Liu, Guoxin Zhang, Pengfei Wan, Kun Gai