arXiv Statistics ML By Sven Serneels

Twoblock clustering trees with coskewness-based dimension reduction: recovering piecewise multivariate linear regimes

Read the original on arXiv Statistics ML →

The paper introduces the twoblock clustering tree (TBTREE), a deterministic regression tree designed for multivariate responses that uses local multivariate linear models as leaves and incorporates dense or sparse twoblock dimension reduction both in the leaf models and impurity calculation. TBTREE aims to provide an interpretable, regime‑aligned piecewise‑linear description of data while maintaining predictive performance through a split/leaf decoupling strategy. Additionally, the authors propose a coskewness‑based estimator for the twoblock reduced space to identify non‑normal clusters, demonstrating the method’s ability to recover piecewise linear regimes in simulations and to model complex nonlinear dependencies in real‑world datasets, achieving performance comparable to black‑box techniques such as random forests.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Statistics ML.

arXiv Machine Learning
Jun 18

Kernel of Partition Paths: A Unified Representation for Tree Ensembles

arXiv:2606. 18853v1 Announce Type: cross Abstract: A recent line of work has reframed individual decision trees as linear models on engineered features associated with their splits, opening routes for oracle inequalities and feature-importance reinterpretation, but leaving open the question of what unified geometric object a forest induces when one indexes its feature map by nodes rather than by splits.

By Nicolas Mahler
arXiv Machine Learning
2d ago

Partially Interpretable Decision Trees

arXiv:2611.06428v1 Announce Type: new Abstract: Partially interpretable models extend simple interpretable models with the option to defer complicated inputs to an accurate but uninterpretable black-...

By Ludovic Schwartz, Federico Berton, Tim van Erven
arXiv Machine Learning
Sep 16

Splitting the Difference: Interpretable Causal Forests for Treatment Effect Heterogeneity and Bias

The paper introduces a new algorithm that uses decision trees and random forests to estimate individual treatment effects while providing interpretability. It modifies the standard random forest splitting criterion by combining a heterogeneity-focused criterion with a bias-correction criterion, enabling the model to handle observational studies with varying treatment propensities without separately estimating propensity scores. The resulting tree structure directly reveals which features drive treatment effect differences, and simulation studies show the method matches or surpasses existing approaches in prediction accuracy while improving interpretability.

By Nicolas Alexander Ihlo, Merle Behr