arXiv Machine Learning

Simulating Classification Models for Ex-Ante Evaluation of Predict-Then-Optimize Methods

The paper extends ex‑ante evaluation of Predict‑Then‑Optimize methods from binary to multiclass classification by simulating predictions at specified performance levels and mapping prediction errors to decision regret. It introduces a first‑order approximation that estimates regret from individual misclassifications, reducing computational effort. Experiments show the simulation accurately reproduces target performance and that the approximation is close for some problems, though it falters when simultaneous misclassifications interact significantly.

arXiv AI
Jul 7

OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers

arXiv:2607. 04033v1 Announce Type: cross Abstract: Optimizer selection for large-scale model training has become a system-level design decision constrained jointly by compute, memory, tuning budget, and task diversity, yet the landscape of over one hundred methods remains fragmented.

By Siyuan Li, Jiabao Pan, Yumou Liu, Zhuoli Ouyang, Xin Jin, Xinglong Xu, Jingxuan Wei, Shengye Pang, Jintao Che, Xuanhe Zhou, Conghui He, Cheng Tan
arXiv Machine Learning
Jul 31

What Is The Performance Ceiling of My Classifier? Utilizing Category-Wise Influence Functions for Pareto Frontier Analysis

arXiv:2510. 03950v2 Announce Type: replace Abstract: Data-centric learning seeks to improve model performance from the perspective of data quality, and has been drawing increasing attention in the machine learning community.

By Shahriar Kabir Nahin, Wenxiao Xiao, Joshua Liu, Anshuman Chhabra, Hongfu Liu
arXiv Machine Learning
4d ago

Achieving More with Less: A Tensor-Optimization-Powered Ensemble Method

The paper proposes a tensor‑optimization‑powered ensemble method that uses confidence tensors to capture how each weak base classifier performs across different classes. By integrating these tensors and a smooth, partially convex objective that emphasizes margin, the method improves both classification accuracy and generalization while requiring fewer base learners. The authors also prove a property of the loss gradient that enables efficient gradient‑based optimization of the constrained problem.

By Jinghui Yuan, Weijin Jiang, Zhe Cao, Fangyuan Xie, Rong Wang, Feiping Nie, Yuan Yuan
arXiv Machine Learning
Jun 29

Non-Linear Strategic Classification Made Practical

arXiv:2606. 28204v1 Announce Type: cross Abstract: Algorithmic developments in Strategic Classification have been mostly limited to linear classifiers in settings where the best response has a closed-form solution or can be easily approximated.

By Jack Geary, Boyan Gao, Henry Gouk