ScoringBench is an open, extensible benchmark that evaluates tabular regression models using a comprehensive set of proper scoring rules—such as weighted CRPS, energy scores, and interval scores—alongside traditional point metrics like RMSE. It covers 101 datasets from diverse domains and offers two ranking protocols: an ordinal Demsar/autorank approach and a magnitude‑preserving z‑score ranking. Experiments show that model rankings vary with the chosen scoring rule, revealing that evaluation metric selection is a core modeling decision, especially when different error types have varying consequences.
By Jonas Landsgesell, Pascal Knoll, Tizian Wenzel
arXiv:2607. 26000v1 Announce Type: cross Abstract: Tabular Foundation Models (TFMs) have emerged as novel approaches for tabular predictive tasks, demonstrating competitive predictive performance to ensemble tree-based models.
By Malena Loza, David Chushig-Muzo, Eva Milara, Luis Bote-Curiel, Luis Estrada-Petrocelli, Felipe Grijalva
Xiaomi-TabLDM is a tabular foundation model that performs classification and regression via in-context learning without task‑specific fine‑tuning. It is pretrained solely on synthetic data from structural causal models, achieving top‑ranked regression results on multiple benchmarks while reducing training and prediction time compared to leading models. The architecture incorporates a three‑stage training strategy, dual‑stream feature grouping, lightweight attention residuals, and sparse mixture‑of‑experts, and it can further improve accuracy through test‑time compute scaling.
By TabLDM Team, Penghui Wang, Wei Liu, Hong Wang, Chengyue Huang, Yuxi Sun, Zirui Wang, Hongming Huang, Quan Wang, Chunxiao Liu, Erli Meng, Bin Wang
EXAONE Tabular 1.0 is a compact tabular foundation model family that performs classification and regression via in-context learning without dataset-specific gradient updates. It is pretrained exclusively on a synthetic structural‑causal‑model prior and introduces an architecture‑centered redesign that interleaves feature‑axis and item‑axis attention within each Transformer layer, mediated by summary tokens. Across four public benchmarks, its 20.81 M‑parameter classification model ranks first on TabArena, surpassing tuned ensembles and AutoML pipelines, while its regression model matches the performance of a 1.64 B‑parameter model at roughly one‑eleventh the inference cost, and it achieves top rankings on BCCO, TALENT, and ScoringBench.
By Moonjung Eo, Min-Kook Suh, Hye-Seung Cho, Jiwon Kim, Seoyoon Kim, Sangjun Nam, Soonyoung Lee
Mitra‑v2 is a tabular foundation model that achieves state‑of‑the‑art performance on a wide range of real‑world classification and regression tasks, including credit‑risk scoring, clinical prediction, equipment‑failure detection, and house‑price estimation. Trained solely on synthetic data with a larger and more diverse pretraining distribution than its predecessor, it uses a compact 2D Transformer backbone and improved optimization to handle longer contexts and larger feature spaces. On the TabArena and TALENT benchmarks, Mitra‑v2 outperforms leading models such as TabPFN‑3 and TabICLv2, matching the performance of a 1.6B‑parameter TabFM with only 77M parameters, and ranks first on multi‑class classification tasks with more than ten classes.
By Yefan Tao (Bernie), Xiyuan Zhang (Bernie), Xinyi Liu (Bernie), Boran Han (Bernie), Danielle Maddix (Bernie), Haoyang Fang (Bernie), Zhen Han (Bernie), Jiading Gai (Bernie), Xuanqing Liu (Bernie), Michael Bohlke-Schneider (Bernie), Yuyang (Bernie), Wang, Gerald Friedland, Kevan Mah, Chris Lee, Chris Kong
arXiv:2606. 29403v1 Announce Type: cross Abstract: Conformal prediction guarantees marginal coverage, but pooled calibration averages over heterogeneous regions and can mask regional undercoverage in safety-critical subgroups.
By Louis Berthier, Ahmed Shokry, Maxime Moreaud, Guillaume Ramelet, Aymeric Dieuleveut
SelectArena is a new benchmark for feature selection on real-world tabular data, evaluating 15 popular methods across 71 curated datasets for both classification and regression tasks. The study uses standardized protocols and modern foundation models, revealing trade-offs among predictive performance, runtime, stability, and validity. Tree-based methods (CART, RFImportance) and the F-Test emerge as Pareto-optimal choices, while search-based methods perform poorly in speed and stability.
By Bastian Sch\"afer, Dominika Matus, Lennart Purucker, Ricardo Knauer, Erik Rodner, Frank Hutter, Anton Sokolov, Arnaud Liefooghe
arXiv:2610.28556v1 Announce Type: cross
Abstract: Large language models (LLMs) can leverage semantic feature names alongside summary statistics for tabular feature selection, yet it remains unclear w...
By Fateme Memar, Dongjie Wang, Arvin Agah
arXiv:2610.01143v1 Announce Type: cross
Abstract: Despite strong mean accuracy, tabular foundation models (TFMs) can perform poorly on underrepresented groups under subpopulation shift, where group p...
By Seonghwi Kim, Sung Ho Jo, Minwoo Chae
arXiv:2606. 02106v1 Announce Type: new Abstract: We present a single classification pipeline that combines an Equiangular Tight Frame (ETF) preprocessing stage with a tabular foundation model for in-context inference, applied identically across modalities once data is mapped to fixed vector representations.
By Julien Lafrance
The paper investigates how synthetic pretraining priors used in tabular foundation models (TFMs) influence downstream performance. By reconstructing the synthetic data generators of four TFMs and comparing their generated tasks to two popular tabular benchmarks using structural descriptors, the authors measure structural coverage and normalized density. They find that some generators provide broader and denser support for benchmark tasks, and that stronger synthetic-to-benchmark support generally correlates with better model performance.
By He Zhao, Ryan Thompson, Daniel M. Steinberg, Ashfaqur Rahman, Edwin V. Bonilla, Cheng Soon Ong
Conformal prediction guarantees marginal coverage, but pooled calibration averages over heterogeneous regions and can mask regional undercoverage in safety-critical subgroups. We introduce Self-Organized Conformal Prediction (SOCP), a calibration scheme that discovers input-space groups with a Self-Organizing Map (SOM) and, at test time, draws a local calibration buffer from the query's best-matching unit (BMU) cell or a fixed grid neighborhood.