Hugging Face Trending Papers

RoBART: Bayesian Additive Regression Trees with Tree-Specific Rotations

arXiv Machine Learning
Sep 24

Dirichlet Process Mixtures of Trees with Gaussian Process Splits: A Bayesian Nonparametric Framework with Posterior Contraction Rate

arXiv:2609. 27930v1 Announce Type: cross Abstract: We propose a Bayesian nonparametric mixture of regression trees with a Dirichlet process prior over tree-parameter pairs, enabling data-driven selection of ensemble size and unifying CART, BART, random forests, and boosting.

By Subhasish Basak, Anik Roy, Sourabh Bhattacharya
arXiv Machine Learning
Aug 18

On Stopping Rules and Spatial Adaptation for CART

arXiv:2608. 15649v1 Announce Type: cross Abstract: The popular CART algorithm for regression trees combines a greedy splitting rule with a stopping rule, but while the splitting rule has been well studied, the statistical role of stopping rules is less well understood.

By Zineng Xu, Yuchao Cai, Yan Shuo Tan
arXiv Statistics ML
Oct 5

A Residual Tree Gaussian Process Modeling Framework for High-Dimensional Data

The paper introduces ResTGP, a Bayesian residual tree Gaussian Process framework designed for large, high‑dimensional spatial datasets with heterogeneous structures. It decomposes a Gaussian process across a dyadic tree, iteratively computing predictive and residual processes at each node to capture multi‑scale covariance efficiently. The method employs recursive message passing for linear‑time Bayesian inference and demonstrates posterior consistency, with numerical experiments and a storm surge application highlighting its advantages.

By Pulong Ma, Li Ma
arXiv Machine Learning
Jun 19

Weighted Bayesian Conformal Prediction

arXiv:2604. 06464v2 Announce Type: replace Abstract: Conformal prediction provides distribution-free prediction intervals with finite-sample coverage guarantees, and recent work by Snell \& Griffiths reframes it as Bayesian Quadrature (BQ-CP), yielding powerful data-conditional guarantees via Dirichlet posteriors over thresholds.

By Xiayin Lou, Peng Luo
arXiv Machine Learning
Sep 25

Nuclear Norm-Regularized Bayesian Matrix Completion

The paper introduces a Bayesian approach to matrix completion that uses a nuclear norm-based prior and addresses the challenge of unknown noise variance by placing a prior on it. It presents the first sampler for this model, providing a non‑asymptotic polynomial‑time guarantee in terms of matrix dimensions and desired accuracy. The method discretizes the noise precision and employs thermodynamic integration to construct a categorical posterior, offering a feasibility result for Bayesian sampling in non‑log‑concave settings.

By Calvin Tolbert
arXiv Machine Learning
Jun 18

Kernel of Partition Paths: A Unified Representation for Tree Ensembles

arXiv:2606. 18853v1 Announce Type: cross Abstract: A recent line of work has reframed individual decision trees as linear models on engineered features associated with their splits, opening routes for oracle inequalities and feature-importance reinterpretation, but leaving open the question of what unified geometric object a forest induces when one indexes its feature map by nodes rather than by splits.

By Nicolas Mahler