arXiv Machine Learning

Classical methods for modern applications: synthetic tabular data generation using lightweight discrete response continuous latent variable model

The paper introduces a lightweight algorithm for modeling tabular data with both continuous and discrete variables. It transforms data into a continuous latent space using empirical marginals and a quantile function, enabling efficient estimation with distributions like a multivariate Gaussian. The method preserves complex marginal distributions and correlations, and handles discrete variables via a Monte Carlo expectation‑maximisation framework that allows conventional maximum‑likelihood estimation.

arXiv AI
Oct 12

Revisiting Tabular Deep Regression: Objectives and the Limits of Global Early Stopping

The paper systematically evaluates regression objectives for tabular deep learning across many datasets and neural backbones, finding that most alternatives to Mean Squared Error (MSE) offer limited or inconsistent gains, while quantile loss consistently improves performance. It identifies a limitation of global early stopping: different noise levels in target regions reach optimal performance at different epochs, causing a compromise. To address this, the authors propose a heteroskedasticity‑aware extension of quantile loss using input‑dependent label smoothing, which outperforms standard quantile loss on several backbones.

By Danil Rudenko, Georgii Bulgakov, Nikolay Kartashev, Ivan Rubachev, Daniil Krasylnikov, Artem Babenko
Hugging Face Trending Papers
Jul 5

Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models

Conditional generative models have emerged as powerful tools for sampling from target conditional distributions, driving substantial advances across a wide range of scientific and applied domains. As these models proliferate, practitioners often face multiple plausible generators whose performance can vary with the task, data, or input condition.

arXiv AI
Aug 11

Tabular Numeric Stretch Transformation

arXiv:2608. 09162v1 Announce Type: cross Abstract: Tabular data presents unique challenges for deep learning due to its heterogeneous nature, where numeric features exhibit diverse distributions, scales, and statistical properties.

By Zihao Ye, Juyong Kim, Johnna Sundberg, Burak Varici, Pradeep Ravikumar
arXiv Machine Learning
Jun 9

ReTabSyn: Realistic Tabular Data Synthesis via Reinforcement Learning

arXiv:2603. 10823v2 Announce Type: replace-cross Abstract: Deep generative models can help with data scarcity and privacy by producing synthetic training data, but they struggle in low-data, imbalanced tabular settings to fully learn the complex data distribution.

By Xiaofeng Lin, Seungbae Kim, Zhuoya Li, Zachary DeSoto, Charles Fleming, Guang Cheng
arXiv AI
Oct 2

ProtoFlow: Prototype-Guided Flow Matching for Multivariate Time Series Forecasting

ProtoFlow is a new multivariate time series forecasting framework that combines vector‑quantized autoencoding with prototype‑guided flow matching. It maps sequences into a discrete latent space, constructs a structured prior from the learned VQ codebook, and trains a DiT‑based rectified flow to transport samples from this prior to future latent representations conditioned on past observations. By replacing generic Gaussian noise with a learned prototype prior, ProtoFlow eliminates autoregressive rollout mismatch and achieves faster training convergence while delivering superior forecasting performance on benchmark datasets.

By Shibo Feng, Wanjin Feng, Yang Qiu, Deheng Ye, Peilin Zhao, Chunyan Miao