Volterra Generative Models
arXiv:2606. 18071v1 Announce Type: cross Abstract: Score-based diffusion models typically use Brownian perturbations, which provide tractable reverse-time dynamics but impose memoryless noising.
The paper introduces Volterra generative models that extend diffusion-based generative models by incorporating Volterra processes, which provide more flexible temporal dependence than traditional Brownian-motion-driven Markov processes. To address the non-Markovian challenges, the authors develop Markovian approximations and Gaussian conditioning, reducing the denoising problem to the original data dimension and enabling connections to variance-exploding and variance-preserving frameworks. The resulting models, trained from scratch or with pretrained denoisers, achieve competitive FID scores on MNIST, conditional CIFAR-10, and ImageNet datasets, demonstrating the practical viability of the approach.
arXiv:2606. 18071v1 Announce Type: cross Abstract: Score-based diffusion models typically use Brownian perturbations, which provide tractable reverse-time dynamics but impose memoryless noising.
arXiv:2609.37147v1 Announce Type: cross Abstract: Distributional Diffusion Models (DDMs) replace the standard mean-prediction denoiser with a \emph{distributional} denoiser trained via a scoring rule...
arXiv:2607. 19332v1 Announce Type: new Abstract: Generative models have undergone many generations of evolution, from VAEs/GANs to diffusion/flow matching.
Generative models have undergone many generations of evolution, from VAEs/GANs to diffusion/flow matching. Along the way, the underlying techniques have become more complicated and various beliefs about what drives strong empirical performance have taken hold.
arXiv:2610.02203v1 Announce Type: new Abstract: In diffusion transformers, a class label or a text prompt is embedded once, and the same condition is reused at every denoising step. We ask whether pr...
The paper introduces Latent Nonlinear Denoising Score Matching (LNDSM), a method that integrates nonlinear, structure-informed latent diffusions with a variational autoencoder framework. LNDSM designs the forward diffusion to admit a chosen reference distribution, such as a Gaussian mixture, and derives a computable approximation to a cross‑entropy upper bound using Euler‑Maruyama discretization. Experiments on benchmark image datasets show that LNDSM improves sample quality, mode balance, and training efficiency compared to conventional latent score‑based generative models.
RepFusion leverages multimodal large language models (MLLMs) as noisy representation encoders to condition a diffusion transformer for denoising in representation space. By reusing MLLM outputs across denoising steps, the method achieves faster inference while maintaining performance comparable to per-step recomputation. Experiments show RepFusion outperforms baselines with similar inference budgets, demonstrating that MLLMs provide strong priors for denoising visual representations.
arXiv:2512. 20963v3 Announce Type: replace Abstract: Diffusion models excel at generating high-quality, diverse samples, yet they risk memorizing training data when overfit to the training objective.
The paper revisits pixel-space diffusion models, showing that a vanilla diffusion transformer can generate directly in pixel space by swapping velocity prediction for clean image prediction. It introduces MFlow, an adaptive parameterization that interpolates between these two prediction modes based on data representation and model capacity, and demonstrates competitive performance on ImageNet, UCF‑101, and text‑to‑image tasks. Additionally, the authors add ConvRefiner, a lightweight convolutional module trained post‑hoc to restore high‑frequency details while preserving FID.
arXiv:2605. 26632v2 Announce Type: replace Abstract: Diffusion Transformers (DiT) achieve strong performance in image generation but incur substantial inference costs.
arXiv:2611.17868v1 Announce Type: new Abstract: While diffusion models excel at image generation, their denoising trajectories pass through corrupted intermediate states far from the image manifold....
arXiv:2606. 20416v1 Announce Type: new Abstract: Diffusion models rely heavily on explicit timestep embeddings to modulate the denoising process across various noise scales.