arXiv Machine Learning

Achieving More with Less: A Tensor-Optimization-Powered Ensemble Method

The paper proposes a tensor‑optimization‑powered ensemble method that uses confidence tensors to capture how each weak base classifier performs across different classes. By integrating these tensors and a smooth, partially convex objective that emphasizes margin, the method improves both classification accuracy and generalization while requiring fewer base learners. The authors also prove a property of the loss gradient that enables efficient gradient‑based optimization of the constrained problem.

arXiv Statistics ML
Oct 21

Optimal aggregation in multiclass classification

arXiv:2610.28025v1 Announce Type: cross Abstract: This paper studies the problem of aggregation in multiclass classification, generalizing existing results for binary classification. Given a finite d...

By Felix Abramovich, Or Davidovitch-Servadio
arXiv Machine Learning
Jul 8

Boosting with List-Decodable Codes

arXiv:2607. 05791v1 Announce Type: cross Abstract: Boosting is a fundamental technique for generically improving the accuracy of learning algorithms (Schapire 1989).

By Addison Prairie, Li-Yang Tan
arXiv Machine Learning
Oct 12

Optimizable Model Averaging for Ensembling Heterogeneous Model Outputs

Optimizable Model Averaging (OMA) is a black‑box method that assigns nonnegative weights to each candidate model’s predictive probabilities, keeping all model parameters frozen. By minimizing regularized predictive entropy, OMA learns a single scalar coefficient per model to average outputs from heterogeneous architectures. The authors show that appropriate regularization reduces expected calibration error and improves the trade‑off between performance and calibration compared to simple output averaging.

By Mijung Park