arXiv Machine Learning

How Many Domains Suffice for Domain Generalization? A Tight Characterization via the Domain Shattering Dimension

arXiv:2506. 16704v3 Announce Type: replace Abstract: We study a fundamental question of domain generalization: given a family of domains (i.

arXiv Machine Learning
Jul 21

Hierarchical Domain Generalization

arXiv:2607. 16528v1 Announce Type: new Abstract: We study hierarchical domain generalization as a problem of extrapolation from finite observed regions to an entire instance space, replacing i.

By Chenxiao Yang, Zhiyuan Li, Shai Ben-David, Nathan Srebro
arXiv Machine Learning
Jun 29

Surprises in Proper Positive-Only Learning

arXiv:2606. 28309v1 Announce Type: cross Abstract: Binary classification from positive-only samples is a variant of PAC learning in which the learner receives i.

By Shai Ben-David, Farnam Mansouri, Anay Mehrotra, Manolis Zampetakis
arXiv Machine Learning
Aug 4

The No-Clash Teaching Dimension is Bounded by VC Dimension

arXiv:2603. 23561v4 Announce Type: replace-cross Abstract: In the realm of machine learning theory, to prevent unnatural coding schemes between teacher and learner, No-Clash Teaching Dimension was introduced as provably optimal complexity measure for collusion-free teaching.

By Jiahua Liu, Benchong Li
arXiv Machine Learning
Jul 28

Learning Distributions from Multiple Data Providers

arXiv:2607. 24732v1 Announce Type: cross Abstract: Motivated by learning from heterogeneous and overlapping data providers, we study a stylized model of distribution learning from restricted conditional samples.

By Jon Kleinberg, Amin Saberi, Xizhi Tan, Grigoris Velegkas
arXiv Machine Learning
Jul 7

Distribution-free Deviation Bounds and The Role of Domain Knowledge in Learning via Model Selection with Cross-validation Risk Estimation

arXiv:2303. 08777v3 Announce Type: replace-cross Abstract: Cross-validation is one of the most widely used tools for risk estimation and model selection in statistics and machine learning, yet its theoretical properties when embedded in a learning procedure remain insufficiently understood.

By Diego Marcondes, Cl\'audia Peixoto
arXiv Machine Learning
Jul 2

Function-Counting Theory for Low-Dimensional Data Structures

arXiv:2607. 01010v1 Announce Type: cross Abstract: The success of deep learning models in classification and regression is widely attributed to the low-dimensional structure that real-world data tend to exhibit, despite their high-dimensional representation.

By Konstantin H\"aberle, Helmut B\"olcskei