arXiv Machine Learning

Theoretical Analysis of Engression and Reverse Markov Engression

arXiv:2606. 01002v1 Announce Type: cross Abstract: Engression is a recently proposed and effective framework for conditional distribution learning.

arXiv Machine Learning
Jul 31

Error Analysis of Neural-Network-Based Engression

arXiv:2607. 27723v1 Announce Type: cross Abstract: Engression (Shen and Meinshausen, 2024) learns a conditional distribution by fitting a generative model $Y = f(X,\varepsilon)$ under the energy score, a strictly proper scoring rule.

By Juntong Chen, Zijian Guo, Xinwei Shen
arXiv AI
Aug 25

Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks

The paper presents a theoretical framework for approximating ratio-type functionals that arise in conditional generative modeling, specifically when the target density is expressed as a ratio of two kernel-based marginal densities. It proves that deep neural networks using the SignReLU activation can approximate these ratios with established L^p(Omega) bounds and convergence rates under standard regularity assumptions. Applying the framework to Denoising Diffusion Probabilistic Models, the authors construct a SignReLU-based estimator for the reverse process and derive bounds on the excess Kullback–Leibler risk, decomposing it into approximation and estimation errors to provide generalization guarantees for finite-sample training.

By Luwei Sun, Dongrui Shen, Feng Chuanwen, Jianfe Li, Yulong Zhao, Han Feng
arXiv Machine Learning
5d ago

Distribution-Conditioned Transport

The paper introduces Distribution‑Conditioned Transport (DCT), a framework that learns transport maps conditioned on embeddings of source and target distributions, allowing generalization to unseen distribution pairs. DCT supports semi‑supervised learning for distributional forecasting by leveraging distributions observed at only one condition. It is agnostic to the transport mechanism and is demonstrated on synthetic benchmarks and four biological applications, including batch effect transfer in single‑cell genomics and modeling T‑cell receptor sequence evolution.

By Nic Fishman, Gokul Gowri, Paolo L. B. Fischer, Marinka Zitnik, Omar Abudayyeh, Jonathan Gootenberg
arXiv Machine Learning
Jun 5

Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization

arXiv:2410. 02628v5 Announce Type: replace Abstract: Learning conditional distributions $\pi^*(\cdot|x)$ is a central problem in machine learning, which is typically approached via supervised methods with paired data $(x,y) \sim \pi^*$.

By Mikhail Persiianov, Arip Asadulaev, Nikita Andreev, Nikita Starodubcev, Dmitry Baranchuk, Anastasis Kratsios, Evgeny Burnaev, Alexander Korotin
arXiv Machine Learning
Sep 11

Particle GFlowNets: Rethinking Generative Marginalization Models

The paper introduces Particle GFlowNets, showing that Generative Marginalization Models (MaMs) are equivalent to Generative Flow Networks. It extends MaMs to non‑autoregressive sampling and proposes an automatic full‑state rejuvenation criterion based on the Gelman‑Rubin statistic to accelerate learning. Experiments demonstrate significant training speedups in large combinatorial spaces.

By Tiago da Silva, Diego Mesquita, Salem Lahlou