arXiv Machine Learning
22h ago

Estimating Spectrum-Free Information Bounds for Generative Surrogates Beyond Conditional Collapse

The paper evaluates conditional generative surrogates used in high‑energy physics, noting that common 1D marginal divergence metrics can mistakenly reward models that ignore conditioning information. Using the Continuous Ranked Probability Skill Score (CRPSS) as a more robust metric, the authors demonstrate that a simple sampler can outperform a trained Mixture Density Network on all target marginals, and that the advantage diminishes when CRPSS is evaluated within bins of the conditioning variable. They further introduce a data‑driven k‑Nearest‑Neighbor extrapolation to estimate the maximum achievable CRPSS given the conditioning information, finding that both models reach this estimate, suggesting current architectures have extracted the available conditioning information for the evaluated targets.

By Chaitanya Dumbre, Sourabh Dube
Hugging Face Trending Papers
Jul 5

Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models

Conditional generative models have emerged as powerful tools for sampling from target conditional distributions, driving substantial advances across a wide range of scientific and applied domains. As these models proliferate, practitioners often face multiple plausible generators whose performance can vary with the task, data, or input condition.

arXiv Machine Learning
Jul 2

Decision-Aware Training for Sample-Based Generative Models

arXiv:2607. 01171v1 Announce Type: new Abstract: Sample-based generative models are increasingly used for probabilistic forecasting in high-stakes decision settings, yet their training objectives are blind to the decision maker's cost structure.

By Kornelius Raeth, Nicole Ludwig
arXiv Machine Learning
Aug 7

Kastor: An efficient fine-tuning strategy for generative emulation of PDE simulations

arXiv:2608. 06107v1 Announce Type: new Abstract: Machine learning offers a promising avenue to accelerate physical simulations by replacing computationally expensive traditional Partial Differential Equation (PDE) solvers with fast, differentiable surrogate models.

By Guillaume Couairon, Alexis Jacq, Yu-Han Wu, Renu Singh, Yana Hasson, Quentin Berthet, Romuald Elie
arXiv Machine Learning
Sep 25

Sufficiently Reduced Distributional Regression

Sufficiently Reduced Distributional Regression (SRDR) is a generative approach that merges conditional distribution estimation with nonlinear sufficient dimension reduction (SDR). By framing SDR as a risk minimization problem using strictly proper scoring rules, SRDR jointly learns a dimension reduction map and a generative prediction model through minimization of the energy score, which can be estimated via sampling. The method extends to multi‑environment data and classification, and theoretical results show convergence of estimated conditional distributions in energy distance, implying asymptotic sufficiency. In experiments on CT slice localization, superconductivity data, and digit classification, SRDR recovers low‑dimensional sufficient structure and matches or surpasses state‑of‑the‑art nonlinear SDR methods in representation quality and predictive performance.

By Alexander Henzi, Tiange Liu, Xinwei Shen