arXiv Machine Learning
Consideration Circuits: Depth Separation and Universality Beyond a Single Softmax
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
Related stories
arXiv Machine Learning
Jul 14
Diversified Multinomial Logit Contextual Bandits
arXiv:2607. 11684v1 Announce Type: cross Abstract: Existing contextual multinomial logit (MNL) bandits model relevance-driven choice but ignore the potential benefits of within-assortment diversity, while submodular/combinatorial bandits encode diversity in rewards but lack structured choice probabilities.
arXiv Machine Learning
Oct 22
The Price of Choice in Selective Prediction
arXiv:2610. 29067v1 Announce Type: new Abstract: A selective classifier may be claimed to satisfy a risk-coverage contract if some rule from a predeclared menu (a threshold or a union of $K$ score intervals) attains coverage at least $\kappa$ and error at most $\alpha$.
arXiv Machine Learning
Aug 27
Optimal Design for Multinomial Logit Model with Applications to Best Assortment Identification
The paper presents a computationally efficient optimal design framework for multinomial logit (MNL) bandits, addressing the combinatorial action space that makes traditional methods infeasible. It introduces two approaches: an exact or certified-approximate mixed-integer linear program with solver‑certified early stopping, and a fully polynomial‑time lifted design using a tractable surrogate objective. Leveraging the Kiefer‑Wolfowitz equivalence theorem, the authors provide near G‑optimality guarantees and apply the framework to develop a best assortment identification algorithm with an instance‑dependent sample complexity of τO((d log N)/Δ²).
arXiv Machine Learning
Aug 10
Multiscale Reward Hedging from Correct Demonstrations
arXiv:2608. 06825v1 Announce Type: new Abstract: Learning from correct demonstrations is harder than supervised learning when many answers are correct: after predicting, the learner sees one valid answer but not whether its own answer was valid, nor any reward.
arXiv AI
Sep 15
Certifiably Interpretable Training of ReLU-MLPs for Boolean Tasks with Guaranteed Truth-Table Generalization
The paper introduces MACCHIATO, a training algorithm that builds a ReLU‑MLP from partial truth‑table data while simultaneously constructing an explicit Boolean circuit over AND, OR, and XOR gates that certifies the network’s computation. The method iteratively projects residuals onto low‑dimensional Boolean classes, compiles the resulting circuit into a ReLU‑MLP, and uses logic minimization and influence‑based variable selection to achieve a six‑layer network with provable truth‑table error bounds. Experiments on synthetic random‑junta tasks show that these certified networks outperform Adam‑trained MLPs in data‑sparse or projection‑aligned regimes and complete faster than flat ESPRESSO in certain settings.
arXiv Machine Learning
Aug 5
Representing Random Utility Choice Models with Neural Networks
arXiv:2207. 12877v3 Announce Type: replace Abstract: Motivated by the successes of deep learning, we propose a class of neural network-based discrete choice models, called RUMnets, inspired by the random utility maximization (RUM) framework.