arXiv Computer Vision

Scout-Refine-Correct: Teaching Flow Models to Refine Their Own Samples

Scout-Refine-Correct (SRC) is a training recipe that equips flow-matching image generation models with an inference-time refinement capability. During sampling, the model performs a scout rollout to predict a full sample, uses this prediction as a self-conditioning signal, and then takes the actual step; this process can be repeated for multiple refinement rounds. On ImageNet-256, SRC improves LightningDiT-B’s FID from ~14.5 to ~7.26 with 550 normalised flow evaluations, matching a best-of‑N baseline that relies on an oracle verifier, and further reduces FID to 3.81 when combined with best-of‑N.

arXiv Computer Vision
Oct 12

VideoAWR: Reinforcing Video Flow Models with Decoupled-Timestep Advantage-Weighted Rectification

VideoAWR introduces a decoupled-timestep advantage‑weighted rectification framework for video flow models, separating guided rollouts from the optimization anchor to avoid geometric guidance blow‑up and cold‑start collapse. The method uses an EMA reference policy for guided rollouts while rectifying against an unguided conditional anchor, proving that the centered advantage cancels the anchor in expectation and retains only reward‑correlated covariance. Experiments on Wan2.1‑1.3B and 14B models show stable training and improved visual and motion quality in both CFG‑free and CFG‑enabled settings.

By Zheming Fu, Wenbin Ning, Ruizhe He, Wei Shang, Xiaoxiao Ma, Lianrui Mu, Chang Liu, Lei Wang, Siming Fu
arXiv AI
Aug 26

PROOF-Gen: From Optimized Data to Better Distillation

PROOF-Gen is a method that improves distillation of tool‑calling models by recovering successful trajectories from teacher failures. It uses per‑scenario prompt optimization to generate corrective guidance that steers the teacher to a passing trajectory, then removes this guidance before training so the student learns from clean demonstrations. On τ2‑bench, PROOF-Gen recovers 93% of failed scenarios, boosting Qwen3‑4B‑Instruct‑2507’s Pass^1 from 0.132 to 0.529 and improving Gemma 4 E4B‑it by 7.2pp on BFCL v4 multi‑turn, while also raising deployed on‑device model performance by up to 5.0pp across response‑quality metrics.

By Anh Ta, Junjie Zhu, Shahin Shayandeh
arXiv AI
Sep 16

ReDraft, Don't Just Distill: Reference-Driven Revision for Continual VLLM Post-Training

ReDraft is a reference‑driven revision method for continual post‑training of large multimodal language models. It uses the model’s own incorrect outputs as references, revises them, verifies the revisions, and fine‑tunes on the accepted ones, thereby combining explicit supervision with policy proximity. On tasks such as Counting, Clock Reading, and Jigsaw, ReDraft outperforms standard supervised fine‑tuning and on‑policy methods, achieving higher target‑task gains while dramatically reducing forgetting.

By Zhihao Zhang, Mingqi Wu, Qiaole Dong, Enyu Zhou, Shuo Li, Boyang Liu, Jiazheng Zhang, Honglin Guo, Xin Guo, Shaofan Liu, Junzhe Wang, Dingwei Zhu, Zhiheng Xi, Minlong Peng, Yuan Hua, Qi Zhang, Tao Gui, Xuanjing Huang
arXiv Computer Vision
Aug 24

Difficulty-Calibrated Interpolation Paths for Conditional Flow Matching

The paper introduces Difficulty-Calibrated Flow Matching, a method that adapts the noise-to-data interpolation schedule in Conditional Flow Matching based on a pilot run’s loss profile. By setting the schedule to the quantile function of this difficulty profile, the training trajectory spends more time where the velocity is hardest to learn. Experiments on CIFAR-10, MNIST, and Fashion‑MNIST show that this calibrated path achieves the best FID on CIFAR‑10 and outperforms all fixed schedules in large‑batch, few‑update settings, where compute is most limited.

By Airin Akter Tania, Md Raihan Khan
Hugging Face Trending Papers
Aug 6

Energy-Guided Flow Matching

Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly.