arXiv:2607. 03839v1 Announce Type: new Abstract: Sparse feature selection is critical for high-dimensional machine learning, yet traditional $\ell_1$-regularized methods are often brittle under observational noise and spurious correlations, leading to unstable feature supports and degraded generalization.
arXiv:2606. 22068v2 Announce Type: replace-cross Abstract: Most real-world datasets used for training supervised learning models are contaminated with noisy data and outliers leading to large prediction errors.
arXiv:2607. 21773v1 Announce Type: new Abstract: In this paper, we propose and study a robust variant of the smart predict-then-optimize approach that accounts for prediction shifts due to disturbance in the covariate feature space.
arXiv:2609. 21342v1 Announce Type: cross Abstract: Real data often contain unusual observations that can exert disproportionate effects on variable selection, especially in complex predictor settings.
arXiv:2607. 05536v1 Announce Type: cross Abstract: Randomized smoothing has emerged as a scalable technique for certifying the adversarial robustness of classifiers.
arXiv:2606. 16050v1 Announce Type: cross Abstract: Robust deep learning under heavy-tailed and impulsive noise remains challenging because conventional losses such as mean squared error (MSE) exhibit unbounded sensitivity to outliers.
The paper introduces Sparsity-Adaptive Sharpness-Aware Minimization (SA‑SAM), a method that adjusts the perturbation radius in sharpness-aware training to remain consistent as model sparsity increases. It also evaluates a Magnitude‑Weighted Hessian (MWH) importance metric derived from second‑order analysis. Experiments on CIFAR‑10‑C, CIFAR‑100‑C, and ImageNet‑100‑C show that SA‑SAM improves corruption robustness at 80–90% sparsity while maintaining clean accuracy, and the study reports inference throughput at deployment‑relevant sparsity levels.
arXiv:2511. 20851v3 Announce Type: replace-cross Abstract: Feature selection remains difficult in modern high-dimensional settings, and established methods such as Boruta and Recursive Feature Elimination are either computationally costly or lack a statistically justified stopping criterion for their importance scores.
arXiv:2609.24126v1 Announce Type: cross Abstract: Black-box machine learning models increasingly deliver strong predictions, but extracting useful information from them, such as a set of important fe...
The paper introduces μs’ autotune, an automatic tuning strategy for the Lasso that optimizes a penalized Gaussian log‑likelihood over regression coefficients and noise standard deviation. Extensive simulations on regression and VAR models show that autotune is faster and yields better generalization and model selection, especially in low signal‑to‑noise regimes. The method also delivers a new noise‑standard‑deviation estimator, a visual diagnostic for sparsity, and is demonstrated on a real‑world financial dataset, with an accompanying R package available on GitHub.
The paper introduces Wave-BLS, a robust Broad Learning System that replaces the traditional squared error loss with an asymmetric, bounded, and smooth wave loss function. This change allows controlled penalization of large errors and eliminates the need for matrix inversion by using a Nesterov accelerated gradient scheme. Experiments on 30 UCI datasets show that Wave-BLS consistently outperforms classical BLS and other robust variants, with statistical tests confirming the significance of the improvements and demonstrating greater resilience to noise and outliers.
arXiv:2606. 31653v1 Announce Type: cross Abstract: Certified training aims to produce models whose predictions can be formally verified against adversarial perturbations, typically by optimising upper bounds on the worst-case loss over an allowed perturbation set.