arXiv Machine Learning By Bartosz Barzdajn, Mateusz Krzyszto\'n

Classical methods for modern applications: synthetic tabular data generation using lightweight discrete response continuous latent variable model

Read the original on arXiv Machine Learning →

The paper introduces a lightweight algorithm for modeling tabular data with both continuous and discrete variables. It transforms data into a continuous latent space using empirical marginals and a quantile function, enabling efficient estimation with distributions like a multivariate Gaussian. The method preserves complex marginal distributions and correlations, and handles discrete variables via a Monte Carlo expectation‑maximisation framework that allows conventional maximum‑likelihood estimation.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
Oct 12

Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping

The paper systematically evaluates regression objectives for tabular deep learning across many datasets and neural backbones, finding that most alternatives to Mean Squared Error (MSE) offer limited or inconsistent gains, while quantile loss consistently improves performance. It identifies a limitation of global early stopping: different noise levels in target regions reach optimal performance at different epochs, causing a compromise. To address this, the authors propose a heteroskedasticity‑aware extension of quantile loss using input‑dependent label smoothing, which outperforms standard quantile loss on several backbones.

By Danil Rudenko, Georgii Bulgakov, Nikolay Kartashev, Ivan Rubachev, Daniil Krasylnikov, Artem Babenko
Hugging Face Trending Papers
Jul 5

Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models

Conditional generative models have emerged as powerful tools for sampling from target conditional distributions, driving substantial advances across a wide range of scientific and applied domains. As these models proliferate, practitioners often face multiple plausible generators whose performance can vary with the task, data, or input condition.

arXiv AI
Aug 11

Tabular Numeric Stretch Transformation

arXiv:2608. 09162v1 Announce Type: cross Abstract: Tabular data presents unique challenges for deep learning due to its heterogeneous nature, where numeric features exhibit diverse distributions, scales, and statistical properties.

By Zihao Ye, Juyong Kim, Johnna Sundberg, Burak Varici, Pradeep Ravikumar