arXiv Machine Learning By Alexandre Bayle, Lucas Janson, Lester Mackey

The Relative Instability of Model Comparison with Cross-validation

Read the original on arXiv Machine Learning →

arXiv:2508. 04409v3 Announce Type: replace-cross Abstract: Cross-validation (CV) is known to provide asymptotically exact tests and confidence intervals for model improvement but only when the model comparison is relatively stable.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv AI
6d ago

Robust to Which Model Change? A Unified Evaluation of Robust Counterfactual Explanations

The paper introduces a unified evaluation protocol for robust counterfactual explanations (CFE), testing six robust methods and two baselines across four tabular datasets under eight types of model change. It shows that robustness scores vary by change type and that methods designed for one change family may not transfer to others, with RobX performing most consistently. The study emphasizes the need for a common protocol that defines model changes, measures their impact, and separates generation performance from robustness.

By Marcin Kostrzewa, Maciej Zi\k{e}ba