arXiv Machine Learning
Jul 8
Universality of Benign Overfitting in Binary Linear Classification
arXiv:2501. 10538v3 Announce Type: replace Abstract: The practical success of deep learning has led to the discovery of several surprising phenomena.
Benign Overfitting in Linear Classifiers with a Bias Term
arXiv:2511. 12840v2 Announce Type: replace-cross Abstract: Overparameterized models often generalize well even when they interpolate noisy training data.
Related stories
arXiv Machine Learning
Jul 27
The Role of Pseudo-labels in Self-training Linear Classifiers on High-dimensional Gaussian Mixture Data
arXiv:2205. 07739v4 Announce Type: replace-cross Abstract: Self-training (ST) is a simple yet effective semi-supervised learning method.
arXiv Machine Learning
Aug 7
Minimax Optimal Early-Stopped Gradient Descent for Gaussian Mixture Classification
arXiv:2608. 06250v1 Announce Type: cross Abstract: In overparameterised classification, training data can be linearly separable even when the underlying distribution is not.
arXiv Machine Learning
Jun 19
Benign overfitting beyond prediction: The ordinary least squares interpolator
arXiv:2309. 15769v3 Announce Type: replace-cross Abstract: Recent advances in deep learning have highlighted the phenomenon of benign overfitting in overparameterized statistical models, sparking significant interest in understanding its foundations.
arXiv Machine Learning
Aug 11
Efficient and Noise-Tolerant PAC Learning of Multiclass Linear Classifiers
arXiv:2605. 18662v2 Announce Type: replace Abstract: Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century.
Hugging Face Trending Papers
Jun 11
Distributional Loss for Robust Classification
This paper proposes a novel loss concept for supervised classification tasks. Rather than enforcing a direct mapping from each input sample to a single assigned label, we define an optimization objective over all classifier outputs as a bimodal Gaussian distribution.
arXiv AI
2d ago
Optimal Transport Reweighting for Robust Learning under Spurious Correlations and Label Noise
arXiv:2610.01028v1 Announce Type: cross Abstract: Machine learning models often suffer performance degradation under subpopulation shift, particularly when spurious correlations cause models to rely...
arXiv Machine Learning
4d ago
When do data mixtures improve scaling laws? Insights from high-dimensional regression
arXiv:2609.38011v1 Announce Type: new Abstract: Modern machine learning systems are trained on mixtures of data from different domains, and choosing the right mixture can substantially improve downst...
arXiv Machine Learning
Jul 21
AOE: Exhaustive Out-of-Distribution Detection via Recalibrating Outlier Labels
arXiv:2605. 28021v2 Announce Type: replace Abstract: Out-of-distribution (OOD) detection is essential for deploying machine learning models in open-world and safety-critical scenarios, where test inputs may deviate from the training distribution and overconfident predictions on unknown samples can lead to unreliable decisions.
arXiv Machine Learning
Jul 7
Improved generalization bounds for binary linear classification via isoperimetry
arXiv:2505. 16713v3 Announce Type: replace-cross Abstract: We examine the concentration of uniform generalization errors around their expectation in binary linear classification problems via an isoperimetric argument.
arXiv AI
Aug 6
LiNC: Lightweight Noise Correction via Per-Sample Trust and Gaussian Mixture Modeling
arXiv:2608. 04147v1 Announce Type: cross Abstract: Label noise is common in medical imaging datasets due to factors such as inter-rater variability, annotation errors, and ambiguous cases.
arXiv Statistics ML
Sep 10
A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning
arXiv:2109.02355v2 Announce Type: replace Abstract: The last decade of progress in machine learning (ML), especially the deep learning era, has raised a number of scientific questions that challenge...