arXiv Machine Learning

Model-Aware Schedules Improve Generation via Fiberwise Optimal Transport

The paper introduces model‑aware schedules for diffusion and flow‑matching generative models by leveraging fiberwise optimal transport. It defines a fiberwise prediction risk that averages optimal‑transport costs between true and predicted signal/noise decompositions, and combines this with kinetic action to derive a closed‑form optimal time allocation. Experiments on DDPMs and flow matching across various targets, datasets, and architectures show that these schedules consistently outperform strong baselines, achieving significant FID reductions and demonstrating empirical universality after normalizing risk profiles.

arXiv Computer Vision
Aug 24

Difficulty-Calibrated Interpolation Paths for Conditional Flow Matching

The paper introduces Difficulty-Calibrated Flow Matching, a method that adapts the noise-to-data interpolation schedule in Conditional Flow Matching based on a pilot run’s loss profile. By setting the schedule to the quantile function of this difficulty profile, the training trajectory spends more time where the velocity is hardest to learn. Experiments on CIFAR-10, MNIST, and Fashion‑MNIST show that this calibrated path achieves the best FID on CIFAR‑10 and outperforms all fixed schedules in large‑batch, few‑update settings, where compute is most limited.

By Airin Akter Tania, Md Raihan Khan
arXiv AI
Aug 24

RiskTraf: Risk-Extrapolated Residual Learning for Multi-Variate Traffic Flow Prediction

RiskTraf introduces a risk-extrapolated residual learning approach for multi-variate traffic flow prediction, leveraging raw flow, speed, and occupancy data from the new PEMSB-3V benchmark. The method freezes a trained spatio-temporal backbone and adds a lightweight residual head that learns from historical speed and occupancy to correct flow predictions across different traffic regimes. Experiments show consistent improvements over various backbones and outperform existing debiasing and distribution-shift adaptation techniques.

By Guangyu Wang, Zhidan Liu
arXiv Computer Vision
Oct 22

Policy-Mask: Budget-Aware Adaptation of Diffusion Features to Discriminative Tasks

Policy‑Mask is a budget‑aware policy that jointly selects a timestep, a diffusion block, and a subset of channels from a frozen diffusion model to optimize downstream discriminative tasks. By normalizing channel scores and training on the downstream objective, it outperforms fixed‑extraction baselines on segmentation, classification, and semantic correspondence, achieving state‑of‑the‑art results on ADE20K, CIFAR‑100, and SPair‑71k. The method also extends to diffusion transformers by mapping U‑Net channels to image‑token hidden dimensions.

By Ivan Listopadov, Maksim Nakhodnov, Aibek Alanov
Hugging Face Trending Papers
Jul 22

Analytic Distribution of Classifier-Free Guidance for Schedule Design

Classifier-free guidance (CFG) is the default mechanism for conditional generation in diffusion models, but the distribution sampled by its deterministic guided dynamics is not captured by the usual product-distribution heuristic $p_0^ωq_0^{1-ω}$. We analyze CFG through the probability flow ODE and derive exact analytic path-integral representations of the induced distributions for both constant and time-dependent guidance.

arXiv AI
6d ago

Self-Supervised Pretraining for PHM: What Transfers, What Does Not, and What Federating It Costs

The study evaluates self‑supervised pretraining for Prognostics and Health Management (PHM) across 47 public datasets, using a compact Transformer encoder trained with masked patch prediction. Transfer performance is highly task‑dependent: it dramatically improves fault‑classification on CWRU and HSG18 but offers no reliable benefit for remaining‑useful‑life estimation on CMAPSS. The authors also compare centralized versus simulated federated pretraining, finding that centralized training generally outperforms federated training under matched budgets, and that the intrinsic SSL loss does not reliably predict downstream performance.

By Jos\'e Sanz-Dur\'an, David Sol\'is-Mart\'in
arXiv AI
5d ago

Preconditioned Flow Matching

Preconditioned Flow Matching introduces a precondition-then-match framework that transforms target distributions into more isotropic representations before training flow matching models. By reshaping intermediate distributions, the method improves conditioning, leading to better low-eigenvalue recovery and enhanced performance metrics such as FID, MMD, precision, and recall across Gaussian, Gaussian-mixture, and high-resolution image datasets. The approach is theoretically justified and empirically validated, with ablations showing gains stem from improved geometry rather than extra parameters.

By Shadab Ahamed, Eshed Gal, Md Shahriar Rahim Siddiqui, Simon Ghyselincks, Moshe Eliasof, Eldad Haber
arXiv AI
Sep 25

Accelerating Video Diffusion via Training-Free Trajectory Routing

The paper introduces TRACK, a training‑free trajectory routing method that accelerates video diffusion by selectively switching between large and small models during denoising steps. A calibration process generates a disagreement score map, guiding the selection of the appropriate model at each step to maintain quality while reducing computational cost. Experiments on Wan 2.1, Cosmos 3, TurboDiffusion, and FastVideo show speedups ranging from 1.95× to 2.73× with comparable quality and diversity.

By Mustafa Munir, Huy Vu, Shreyas Misra, Rohit Jena, Sajad Norouzi, Ali Taghibakhshi, Anis Ahmad, Anjul Patney, Pavlo Molchanov, Nima Tajbakhsh
Hugging Face Trending Papers
Sep 24

Accelerating Video Diffusion via Training-Free Trajectory Routing

Accelerating Video Diffusion via Training-Free Trajectory Routing (TRACK) introduces a heterogeneous denoising strategy that switches between large and small diffusion models at selected steps, determined by a calibration process that measures disagreement between model predictions. By routing quality-sensitive steps to the large model and low-disagreement steps to the small model, TRACK achieves significant speedups—up to 2.73×—across several video diffusion benchmarks while maintaining comparable quality and diversity. The method requires no retraining, architectural changes, or online dual-model evaluation, making it a practical acceleration paradigm for video diffusion.