arXiv Machine Learning

Learning DNF through Generalized Fourier Representations

arXiv:2506. 01075v2 Announce Type: replace-cross Abstract: The Boolean Fourier representation has been widely used in learning theory, particularly for learning Disjunctive Normal Form (DNF) under uniform and product distributions.

arXiv Machine Learning
Jun 5

Inverse Entropic Optimal Transport Solves Semi-supervised Learning via Data Likelihood Maximization

arXiv:2410. 02628v5 Announce Type: replace Abstract: Learning conditional distributions $\pi^*(\cdot|x)$ is a central problem in machine learning, which is typically approached via supervised methods with paired data $(x,y) \sim \pi^*$.

By Mikhail Persiianov, Arip Asadulaev, Nikita Andreev, Nikita Starodubcev, Dmitry Baranchuk, Anastasis Kratsios, Evgeny Burnaev, Alexander Korotin
arXiv Machine Learning
Sep 22

On Generalized Naive Bayes with Continuous Features

The paper extends the Generalized Naive Bayes (GNB) model to handle continuous explanatory variables. It shows that GNB structure learning depends only on pair copulas of bivariate marginals and can be framed as a matroid, enabling greedy algorithms that minimize Kullback–Leibler divergence. Three model variants are explored—joint Gaussian, Gaussian copula with arbitrary marginals, and fully arbitrary copula and marginals—along with a GNB forest-based model reduction method and empirical comparisons to classical glass‑box classifiers.

By \'Abrah\'am Papp, Botond Szil\'agyi, Edith Alice Kov\'acs
arXiv AI
Sep 16

Scalable Algorithms for Approximate DNF Model Counting

The paper introduces a new Monte Carlo algorithm for approximate counting of Disjunctive Normal Form (DNF) formulas, featuring an adaptive stopping rule and short‑circuit evaluation. It achieves PAC learning bounds and is asymptotically more efficient than existing methods, including classical Monte Carlo, hashing‑based, and neural‑network approaches. Experiments demonstrate that the algorithm outperforms prior techniques by orders of magnitude and scales to problems with millions of variables.

By Paul Burkhardt, David G. Harris, Kevin T Schmitt
arXiv Machine Learning
Sep 17

Efficient Robust Learning at the Information-Theoretic Limit

The paper presents a polynomial‑time algorithm for robustly learning Boolean concept classes with respect to a fixed distribution, achieving the optimal error rate of η + ε where η is the noise rate. It builds on Blanc’s earlier, computationally inefficient algorithm and introduces no‑regret learners to overcome the previous limitations. Additionally, the authors provide an efficient method that does not require an ERM oracle for any function class admitting sandwiching polynomials under hypercontractive distributions, including a first polynomial‑time solution for learning halfspaces with Gaussian marginals at error η + ε.

By Adam R. Klivans, Konstantinos Stavropoulos, Sergei Tikhonov, Arsen Vasilyan