arXiv Machine Learning

Learning the Pareto Frontier of Predictive Models under Distribution Shift

arXiv:2608. 00632v1 Announce Type: new Abstract: Modern machine learning pipelines increasingly rely on reusing pretrained and foundation models across downstream tasks.

arXiv AI
Jul 7

A Step Towards Robust Unsupervised Domain Adaptation via Fine-Tuning and Reinforcement Learning

arXiv:2607. 03600v1 Announce Type: cross Abstract: Adversarial robustness in Unsupervised Domain Adaptation (UDA) remains a significant challenge due to noisy pseudo labels and inherent distributional shifts between the clean source and adversarially perturbed target domains.

By Sushant Dagaji Desale, Rahul Mishra, Ashutosh Kumar Sinha
arXiv Machine Learning
Sep 11

Are We Really Doing Few-Shot Learning? A Critical Examination of Pre-Training Assumptions

The paper critically evaluates common few‑shot learning protocols that rely on pre‑training a model on a large auxiliary set with classes disjoint from the target but drawn from the same visual domain. By comparing no pre‑training, class‑disjoint in‑domain pre‑training, supervised out‑of‑domain pre‑training, and label‑free out‑of‑domain pre‑training across eight datasets and three architectures, the authors find that in‑domain pre‑training yields a 33.41‑point average improvement, while out‑of‑domain pre‑training offers a 23.75‑point gain, revealing a 9.66‑point optimistic bias due to domain overlap. They also demonstrate that a label‑free augmentation strategy can match supervised out‑of‑domain performance and propose a descriptor‑based source‑selection method that closely approximates oracle selection, underscoring the need to move beyond in‑domain pre‑training as the default evaluation protocol.

By Alejandro Galan-Cuenca, Marcelo Saval-Calvo, Antonio Javier Gallego
arXiv AI
Sep 7

Adaptation Interfaces for In-Context Tabular Foundation Models in Time-to-Event Prediction

The paper explores how to adapt tabular foundation models (TabFMs) for censored time‑to‑event prediction by linking them with CoxPH and DeepHit and revising training procedures. It evaluates zero‑shot, classification‑based fine‑tuning, and survival‑head adaptations across 74 single‑risk and 4 competing‑risk datasets, finding that zero‑shot works best on small datasets while supervised adaptation excels as data grows. The study shows that the choice of adaptation interface and data regime critically influences TabFM transfer performance.

By Minh-Khoi Pham, Luca Cotugno, Dan Cernei, Alina Sirbu, Stefano Masi, Giuseppe Prencipe, Alessandro Pingitore, Patrizia Landi, Working Group on Uric Acid, Cardiovascular Risk of the Italian Society of Hypertension, Tai Tan Mai, Martin Crane, Marija Bezbradica