arXiv Machine Learning

A Bregman Perspective on Classification and Regression Trees

arXiv:2606. 13984v2 Announce Type: replace-cross Abstract: Classification and Regression Trees (CART) constitute one of the most influential paradigms in statistical learning.

arXiv Machine Learning
1d ago

On Stopping Rules and Spatial Adaptation for CART

arXiv:2608. 15649v1 Announce Type: cross Abstract: The popular CART algorithm for regression trees combines a greedy splitting rule with a stopping rule, but while the splitting rule has been well studied, the statistical role of stopping rules is less well understood.

By Zineng Xu, Yuchao Cai, Yan Shuo Tan
arXiv Machine Learning
Jun 18

Kernel of Partition Paths: A Unified Representation for Tree Ensembles

arXiv:2606. 18853v1 Announce Type: cross Abstract: A recent line of work has reframed individual decision trees as linear models on engineered features associated with their splits, opening routes for oracle inequalities and feature-importance reinterpretation, but leaving open the question of what unified geometric object a forest induces when one indexes its feature map by nodes rather than by splits.

By Nicolas Mahler
arXiv Machine Learning
Aug 7

Realizable Bayes-Consistency for General Metric Losses

arXiv:2605. 03823v3 Announce Type: replace Abstract: We study strong universal Bayes-consistency in the realizable setting for learning with general metric losses, extending classical characterizations beyond $0$-$1$ classification (Bousquet et al.

By Dan Tsir Cohen, Steve Hanneke, Aryeh Kontorovich