arXiv Machine Learning
Jul 30
Feature Bagging Provides Stability
arXiv:2607. 26964v1 Announce Type: cross Abstract: We study feature bagging through the lens of algorithmic stability.
Feature Bagging Provides Stability
We study feature bagging through the lens of algorithmic stability. Feature bagging is an ensemble strategy that aggregates base learners trained on randomly subsampled feature subsets, possibly in a data-dependent manner.
Related stories
arXiv Machine Learning
Jun 2
RobustModelMaker: Coupling Bootstrap Stability Selection with Leakage-Safe Nested Cross-Validation for Scientific Machine Learning
arXiv:2606. 01566v1 Announce Type: new Abstract: Small-to-medium scientific datasets place machine learning pipelines under two compounding pressures.
arXiv Machine Learning
Aug 4
Beyond Noise: A Hypothesis Testing Approach to Robust Feature Selection
arXiv:2511. 20851v3 Announce Type: replace-cross Abstract: Feature selection remains difficult in modern high-dimensional settings, and established methods such as Boruta and Recursive Feature Elimination are either computationally costly or lack a statistically justified stopping criterion for their importance scores.
arXiv AI
Jun 15
Simplex-Constrained Sparse Bagging: Transitioning from Uniform Priors to Sparse Posteriors in Ensemble Learning
arXiv:2606. 13589v1 Announce Type: cross Abstract: We present Simplex-Constrained Sparse Bagging (SCSB), a mathematically rigorous framework for post-training compression and probability calibration of bootstrap-based bagging ensembles.
arXiv Machine Learning
Jun 15
Federated Learning for Feature Generalization with Convex Constraints
arXiv:2606. 14416v1 Announce Type: new Abstract: Federated learning (FL) often struggles with generalization due to heterogeneous client data.
arXiv Machine Learning
5d ago
Bagging Robustly Learns VC Classes with Linear Sample Complexity
arXiv:2608. 13514v1 Announce Type: cross Abstract: We revisit the problem of learning predictors robust to adversarial examples at test-time.
arXiv Machine Learning
Jul 7
Adversarial LassoNet: Robust Feature Selection via Stability-Driven Sparse Learning
arXiv:2607. 03839v1 Announce Type: new Abstract: Sparse feature selection is critical for high-dimensional machine learning, yet traditional $\ell_1$-regularized methods are often brittle under observational noise and spurious correlations, leading to unstable feature supports and degraded generalization.
Hugging Face Trending Papers
6d ago
Bagging Robustly Learns VC Classes with Linear Sample Complexity
We revisit the problem of learning predictors robust to adversarial examples at test-time. We prove that VC classes are adversarially robustly learnable with sample complexity linear in the VC dimension $d$, providing an exponential improvement over the previous upper bound of Montasser, Hanneke, and Srebro (2019).
arXiv Machine Learning
Jul 17
Cross-Cluster Weighted Forests
arXiv:2105. 07610v5 Announce Type: replace-cross Abstract: Building trustworthy machine learning algorithms for biological applications requires adapting to data heterogeneity from different sources, batches, distributions, or studies.
arXiv Machine Learning
1d ago
ARISE: An adaptive residual-informed stability ensemble for feature selection in small-sample biomedical omics
arXiv:2608. 14866v1 Announce Type: cross Abstract: Objective: Small-sample molecular classification requires feature selectors that identify predictive, stable, and nonredundant subsets for binary and multiclass outcomes.
arXiv Machine Learning
Jun 11
PCS-UQ: Uncertainty Quantification via the Predictability-Computability-Stability Framework
arXiv:2505. 08784v2 Announce Type: replace-cross Abstract: As machine learning (ML) enters high-stakes domains, trustworthy uncertainty quantification (UQ) is essential for safety.
arXiv Machine Learning
Jun 25
Model-agnostic Mitigation Strategies of Data Imbalance for Regression
arXiv:2506. 01486v2 Announce Type: replace Abstract: Data imbalance persists as a pervasive challenge in regression tasks, introducing bias in model performance and undermining predictive reliability.