arXiv Machine Learning By Luyi Jia, Boyan Zhang, Yilun Liu, Steffen Rulands

Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport

Read the original on arXiv Machine Learning →

The paper introduces model‑aware schedules for diffusion and flow‑matching generative models by leveraging fiberwise optimal transport. It defines a fiberwise prediction risk that averages optimal‑transport costs between true and predicted signal/noise decompositions, and combines this with kinetic action to derive a closed‑form optimal time allocation. Experiments on DDPMs and flow matching across various targets, datasets, and architectures show that these schedules consistently outperform strong baselines, achieving significant FID reductions and demonstrating empirical universality after normalizing risk profiles.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Computer Vision
Aug 24

Difficulty-Calibrated Interpolation Paths for Conditional Flow Matching

The paper introduces Difficulty-Calibrated Flow Matching, a method that adapts the noise-to-data interpolation schedule in Conditional Flow Matching based on a pilot run’s loss profile. By setting the schedule to the quantile function of this difficulty profile, the training trajectory spends more time where the velocity is hardest to learn. Experiments on CIFAR-10, MNIST, and Fashion‑MNIST show that this calibrated path achieves the best FID on CIFAR‑10 and outperforms all fixed schedules in large‑batch, few‑update settings, where compute is most limited.

By Airin Akter Tania, Md Raihan Khan
arXiv AI
Aug 24

RiskTraf: Risk-Extrapolated Residual Learning for Multi-Variate Traffic Flow Prediction

RiskTraf introduces a risk-extrapolated residual learning approach for multi-variate traffic flow prediction, leveraging raw flow, speed, and occupancy data from the new PEMSB-3V benchmark. The method freezes a trained spatio-temporal backbone and adds a lightweight residual head that learns from historical speed and occupancy to correct flow predictions across different traffic regimes. Experiments show consistent improvements over various backbones and outperform existing debiasing and distribution-shift adaptation techniques.

By Guangyu Wang, Zhidan Liu
arXiv Computer Vision
Oct 22

Policy-Mask: Budget-Aware Adaptation of Diffusion Features to Discriminative Tasks

Policy‑Mask is a budget‑aware policy that jointly selects a timestep, a diffusion block, and a subset of channels from a frozen diffusion model to optimize downstream discriminative tasks. By normalizing channel scores and training on the downstream objective, it outperforms fixed‑extraction baselines on segmentation, classification, and semantic correspondence, achieving state‑of‑the‑art results on ADE20K, CIFAR‑100, and SPair‑71k. The method also extends to diffusion transformers by mapping U‑Net channels to image‑token hidden dimensions.

By Ivan Listopadov, Maksim Nakhodnov, Aibek Alanov
Hugging Face Trending Papers
Jul 22

Analytic Distribution of Classifier-Free Guidance for Schedule Design

Classifier-free guidance (CFG) is the default mechanism for conditional generation in diffusion models, but the distribution sampled by its deterministic guided dynamics is not captured by the usual product-distribution heuristic $p_0^ωq_0^{1-ω}$. We analyze CFG through the probability flow ODE and derive exact analytic path-integral representations of the induced distributions for both constant and time-dependent guidance.