arXiv Machine Learning

Jumping up and down: Denoiser diffusion models for discrete ordinal data

arXiv Computer Vision
Aug 25

Ordinal Diffusion Models for Color Fundus Images

The paper introduces an ordinal latent diffusion model for generating color fundus images that incorporates the ordered structure of diabetic retinopathy (DR) severity, using a scalar disease representation instead of categorical conditioning. Evaluations on the EyePACS dataset show improved visual realism, with reduced Fréchet inception distance for most stages and a higher quadratic weighted κ from 0.79 to 0.87. Interpolation experiments demonstrate the model captures a continuous spectrum of disease progression derived from coarse, ordered labels.

By Gustav Schmidt, Philipp Berens, Sarah M\"uller
arXiv AI
Jun 9

DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression

arXiv:2606. 07599v1 Announce Type: cross Abstract: Ordinal Regression (OR) aims to predict target values with inherent order, underpinning critical applications across diverse domains, from recommender systems to computer vision.

By Hongxu Ma, Lin Wang, Chenghou Jin, Han Zhou, Jie Zhang, Xiaoyu Yang, Chunjie Chen, Jihong Guan, Shuigeng Zhou
arXiv Machine Learning
Aug 10

Convergence of Diffusion Models Under the Manifold Hypothesis in High-Dimensions

arXiv:2409. 18804v3 Announce Type: replace-cross Abstract: Denoising Diffusion Probabilistic Models (DDPM) are powerful state-of-the-art methods used to generate synthetic data from high-dimensional data distributions and are widely used for image, audio, and video generation as well as many more applications in science and beyond.

By Iskander Azangulov, George Deligiannidis, Judith Rousseau
arXiv Machine Learning
Jul 14

CANDI: Hybrid Discrete-Continuous Diffusion Models

arXiv:2510. 22510v3 Announce Type: replace Abstract: While continuous diffusion has shown remarkable success in continuous domains such as image generation, its direct application to discrete data has underperformed pure discrete formulations.

By Patrick Pynadath, Jiaxin Shi, Ruqi Zhang
arXiv AI
Jun 8

CountsDiff: A Diffusion Model on the Natural Numbers for Generation and Imputation of Count-Based Data

arXiv:2604. 03779v2 Announce Type: replace-cross Abstract: Diffusion models have excelled at generative tasks for both continuous and token-based domains, but their application to discrete ordinal data remains underdeveloped.

By Renzo G. Soatto, Anders Hoel, Greycen Ren, Shorna Alam, Stephen Bates, Nikolaos P. Daskalakis, Caroline Uhler, Maria Skoularidou
arXiv Computation and Language
5d ago

Simplex Relaxation for Discrete Diffusion

arXiv:2608.10615v2 Announce Type: replace Abstract: Discrete diffusion models for categorical generation are defined by a corruption kernel, which determines the intermediate state space and the asso...

By Jinya Sakurai, Patrick Pynadath, Satoshi Hayakawa, Jaehong Yoon, Xulei Yang, Nancy F. Chen, Xun Xu
arXiv Computer Vision
Aug 25

Improved denoising diffusion probabilistic models with efficient non-diagonal covariance modeling

The paper proposes a new covariance model for Denoising Diffusion Probabilistic Models (DDPMs) that captures non‑diagonal correlations and the power‑law frequency spectrum of natural images. Using a Kronecker‑factored DCT (K‑DCT) decomposition, the authors reduce computational complexity from quadratic to log‑linear, enabling efficient sampling with few steps. Experiments on CIFAR‑10, Celeb‑A, ImageNet, and LSUN demonstrate improved FID and likelihoods over previous state‑of‑the‑art samplers.

By Rui Xia, Ayan Das, Artem Artemev, Andi Zhang, Guillaume Hennequin, Alberto Bernacchia
Hugging Face Trending Papers
Jul 15

Discrete Diffusion Models: A Unified Framework from Tokenization to Generation

Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and iterative global refinement capabilities. Unlike continuous diffusion, where the state space is fixed, DDMs are fundamentally shaped by how the discrete state space is constructed: the tokenization scheme, the vocabulary topology, and domain-specific structural alphabets.