arXiv Machine Learning
Aug 18
Learning Auditable Classifier Models: Source-Disjoint Tree Ensembles
arXiv:2608. 15725v1 Announce Type: new Abstract: Predictive models in clinical and regulated settings must be accurate and fully auditable.
Sparse Oblique Rule Boosting for Simpler Additive Rule Ensembles
Related stories
arXiv Machine Learning
Jul 7
TT-Sparse: Learning Sparse Rule Models with Differentiable Truth Tables
arXiv:2603. 07606v2 Announce Type: replace Abstract: Interpretable machine learning is essential in high-stakes domains where decision-making requires accountability, transparency, and trust.
arXiv Machine Learning
Sep 2
Neural Symbollic Regression Using Deep Learning and Sparse Modelling
Neural Symbolic Regression (NSR) uses neural networks as functional preconditioners to learn smooth, noise‑robust approximations of target functions in an interaction‑aware nonlinear feature space. A subsequent LASSO step extracts sparse, interpretable closed‑form expressions, while distributed hyperparameter optimization with Ray Tune and ASHA scheduling improves predictive accuracy and symbolic fidelity. Experiments on the Nguyen benchmark demonstrate that NSR outperforms SINDy and untuned neural baselines in RMSE, noise robustness, and out‑of‑distribution generalization, with ablation studies highlighting the importance of feature interactions, neural depth, and tuning strategies.
arXiv Machine Learning
Oct 15
Optimizing Sparse Boolean Rule Networks using Mixed Integer Linear Programming
The paper introduces mixed integer linear programming (MILP) formulations for training sparse disjunctive normal form (DNF) networks, which are small networks with a conjunctive hidden layer and a disjunctive output layer. By fixing the network structure and optimizing weights, the authors achieve globally optimized rule sets that balance misclassification costs against sparsity. Their enhanced formulation reduces integer decision variables and redundant constraints, and a combined initialization and dropout approach breaks weight symmetries to promote diverse, stable rule representations, leading to improved computational efficiency and competitive accuracy on synthetic and UCI datasets.
arXiv Machine Learning
Aug 31
SymboLLM-FE: LLM-Accelerated Symbolic Regression for Automated Feature Engineering on Tabular Data
SymboLLM-FE combines symbolic regression and large language models to automate feature engineering for tabular data. It first extracts mathematically expressive formulas that correlate strongly with the target, then refines them with LLMs to improve interpretability. Experiments on six real‑world datasets and four Kaggle competitions show that SymboLLM‑FE outperforms existing AutoFE methods while reducing the number of costly LLM calls.
arXiv Machine Learning
6d ago
Robust Learning of Multi-Index Models under Logconcave Distributions via Weak Partial Learners
The paper introduces a new algorithmic framework for learning Boolean concept classes under logconcave distributions, focusing on multi‑index models. It leverages a boosting approach based on weak partial learners, overcoming the need for distribution‑free weak learners by using a recursive moment‑based partitioning procedure that aligns low‑degree moments of conditioned distributions with the original logconcave distribution. This yields faster robust learners for fundamental concept classes such as functions of halfspaces and multiclass linear classifiers, and includes an efficient method for detecting moment discrepancies that may be useful beyond this work.
arXiv Machine Learning
Jul 16
Parallel gradient boosting for flexible estimation of conditional distributions
arXiv:2607. 13550v1 Announce Type: cross Abstract: Boosting is one of the most successful learning techniques for standard classification and regression tasks.
arXiv AI
Jul 7
RLIE: Rule Generation with Logistic Regression, Iterative Refinement, and Evaluation for Large Language Models
arXiv:2510. 19698v3 Announce Type: replace Abstract: Large Language Models (LLMs) can propose rules in natural language, sidestepping the need for a predefined predicate space in traditional rule learning.
Hugging Face Trending Papers
Jul 15
Parallel gradient boosting for flexible estimation of conditional distributions
Boosting is one of the most successful learning techniques for standard classification and regression tasks. Its extension to multi-output prediction problems has found an increasing number of applications in recent years.
arXiv Machine Learning
Jul 1
Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again
arXiv:2606. 30995v1 Announce Type: new Abstract: Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains.
arXiv Machine Learning
Jun 24
Experiments with Optimal Model Trees
arXiv:2503. 12902v4 Announce Type: replace Abstract: Model trees provide an appealing way to perform interpretable machine learning for both classification and regression problems.
arXiv AI
Oct 15
Coding LLMs Can Be Harnessed to Learn Interpretable Models from Data
arXiv:2610.14006v1 Announce Type: cross Abstract: Since compact, interpretable classifiers correspond to simple programs, it is natural to ask if LLM-based coding agents can be used to learn interpre...