arXiv AI

TabMosaic: Unified In-Context Diffusion for Tabular Generative Tasks

arXiv Machine Learning
Oct 12

Transformer-based In-Context Score Operator Learning for Diffusion Models

The paper introduces a transformer-based framework that learns an in‑context score operator for diffusion models, allowing the model to perform reverse‑diffusion sampling on unseen target distributions specified by a small empirical context set. By representing the task‑dependent score as a Gaussian‑kernel conditional mean and approximating it with a transformer‑based query‑dependent attention architecture, the method can adapt to new tasks without retraining or parameter updates. The authors provide theoretical generalization‑error bounds and evaluate the approach on scientific and visual datasets, noting strong performance on simple task families and limitations as task complexity grows.

By Wuzhe Xu, Zhaiming Shen, Yulong Lu, Wenjing Liao, Rongjie Lai
Hugging Face Trending Papers
Jun 29

UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception

Recent advances in diffusion models have shown impressive performance in controllable image generation and dense prediction tasks. However, existing approaches typically treat diffusion-based controllable generation and dense prediction as separate tasks, overlooking the potential benefits of jointly modeling the heterogeneous distributions.

arXiv AI
Jun 26

Limited Reference, Reliable Generation: A Two-Component Framework for Tabular Data Generation in Low-Data Regimes

arXiv:2509. 09960v2 Announce Type: replace-cross Abstract: Synthetic tabular data generation is increasingly essential in machine learning, supporting downstream applications when real-world, high-quality tabular data is insufficient.

By Mingxuan Jiang, Keyang Chen, Yongxin Wang, Yongsheng Zhao, Ziyue Dai, Yicun Liu, Zeping Li, Qiuyang Zhang, Hongyi Nie, Hongbin Zhu, Sen Liu, Guangnan Ye, Hongfeng Chai
arXiv Machine Learning
Oct 9

Beyond Distributional Fidelity: Causal-Penalized Diffusion for Synthetic Tabular Data

The paper introduces a causal‑penalized diffusion model for generating synthetic tabular data, arguing that high statistical fidelity does not guarantee accurate causal inference. It defines causal fidelity as the discrepancy between inferential distributions from real and synthetic data and proposes a training framework that adds a causal discrepancy penalty to the generative objective. Experiments on treatment‑effect simulations and benchmark datasets demonstrate that the method can improve causal fidelity while maintaining competitive statistical fidelity.

By Lan Tao, Yongxian He, Shirong Xu, Yidong Ouyang, Guang Cheng