← Back to all news
arXiv AI By Jules Kreuer, Sofiane Ouaari, Julia Hellmig, Julius Braitinger, Nico Pfeifer

TabBench-Bio: A Living Benchmark for Machine Learning on High-Dimensional Biomedical Tables

Read the original on arXiv AI →

TabBench-Bio is a living, interactive benchmark that evaluates machine learning models on 43 high‑dimensional biomedical tables, covering multiple domains. Using a shared cross‑validation protocol, the benchmark compares classical estimators, neural networks, and tabular foundation models across 28 feature‑by‑sample operating points, with RealTabPFN v2.5 achieving the highest performance at the reference cell of 10,000 features and 100 training samples. The benchmark provides reproducible results, fold‑level predictions, and invites community contributions to expand its dataset collection.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv Machine Learning
Sep 17

TabICLv2: A better, faster, scalable, and open tabular foundation model

TabICLv2 is a new state‑of‑the‑art tabular foundation model that outperforms existing methods on regression and classification tasks. It relies on a synthetic data generation engine for diverse pretraining, architectural innovations such as a scalable softmax attention, and optimized training protocols that replace AdamW with the Muon optimizer. On the TabArena and TALENT benchmarks, TabICLv2 surpasses the current best model, RealTabPFN‑2.5, without any tuning, while also being faster and capable of handling million‑scale datasets with limited GPU memory.

By Jingang Qu, David Holzm\"uller, Ga\"el Varoquaux, Marine Le Morvan
llmsfine-tuningbenchmarks
More like this →
arXiv Machine Learning
Aug 14

TabH2O: A Unified Foundation Model for Tabular Prediction

arXiv:2605. 18383v2 Announce Type: replace Abstract: We present TabH2O, a foundation model for tabular data that performs classification and regression in a single forward pass via in-context learning.

By Pascal Pfeiffer, Dmitry Gordeev, Mathias M\"uller, Laura Fink, Joan Salv\`a Soler, Mark Landry, Branden Murray, Marcos V. Conde, Sri Satish Ambati
llmsbenchmarks
More like this →
arXiv Machine Learning
Aug 14

CoMedBench: A Multi-Source Benchmark of Synthetic Medical Data Fidelity and Downstream Utility

arXiv:2608. 12805v1 Announce Type: new Abstract: Access to clinical data is essential for developing reliable healthcare machine learning systems, but direct use of electronic health records is constrained by privacy regulation, institutional review, data-use agreements, and the risk of re-identification.

By Akanta Das, Al Amin Farhad, Mrinmoy Sarkar Anto, David Rehkopf, Ayin Vala, Tanmoy Sarkar Pias
benchmarkssafety
More like this →
arXiv AI
Jun 30

Beyond IID: How General Are Tabular Foundation Models, Really?

arXiv:2606. 30410v1 Announce Type: cross Abstract: Foundation models for predictive machine learning on tabular data have recently gained significant traction in academia and industry.

By Lennart Purucker, Andrej Tschalzev, Nick Erickson, Gioia Blayer, David Holzm\"uller, Alan Arazi, Alexander Pfefferle, Mustafa Tajjar, Ga\"el Varoquaux, Frank Hutter
benchmarks
More like this →
arXiv Machine Learning
Oct 5

Below what training size do deep tabular generators stop beating trivial baselines? A preregistered benchmark on a size ladder of clinical and standard datasets

The study benchmarks seven deep tabular generative models against trivial baselines across a size ladder of 8 public datasets (200–20,000 rows) and 4 small clinical datasets, totaling 2,220 runs. Using AUROC of classifiers trained on synthetic data and tested on real data, it finds that in 23 of 24 model–dataset pairs no deep model surpasses the best trivial baseline beyond seed noise, and the best baseline wins 40 of 49 evaluated cells. Rankings of deep models are relatively stable below 5,000 rows, but the top two methods often differ by less than seed variation, and rankings on small clinical datasets only moderately align with those on subsampled large datasets.

By Shivam Shrivastava
benchmarks
More like this →