arXiv Machine Learning

On the Sample Complexity of Active Learning with Membership Queries

The paper investigates how the ability to synthesize arbitrary queries (membership queries) changes the sample complexity of active learning compared to the traditional pool-based setting. It shows that some hypothesis classes that only achieve polynomial error decay with pool-based queries become exponentially learnable when synthesis is allowed, revealing a significant gap in learning difficulty. The authors propose sufficient conditions, provide examples, and suggest a conjectural framework to identify classes that benefit from synthesized queries.

arXiv Machine Learning
Jun 10

Robust Regression of General ReLUs with Queries

arXiv:2606. 11130v1 Announce Type: new Abstract: We study the task of agnostically learning general (as opposed to homogeneous) ReLUs under the Gaussian distribution with respect to the squared loss.

By Ilias Diakonikolas, Daniel M. Kane, Mingchen Ma
arXiv Machine Learning
Jun 2

Incentivized Collaboration in Active Learning

arXiv:2311. 00260v2 Announce Type: replace-cross Abstract: In collaborative active learning, where multiple agents try to learn labels from a common hypothesis, we introduce an innovative framework for incentivized collaboration.

By Lee Cohen, Han Shao
arXiv Machine Learning
Jul 7

Active Learning on Adversarially Corrupted Graphs

arXiv:2607. 04869v1 Announce Type: new Abstract: Motivated by real-world scenarios where malicious entities tamper with existing networks, we define a model where an adversary seeks to hide a set of \emph{corrupted vertices} inside a graph $G^*$.

By Marco Bressan, Nicol\`o Cesa-Bianchi, Tommaso d`Orsi, Emmanuel Esposito, Silvio Lattanzi
arXiv Machine Learning
Sep 11

Relatively Smart II: Tractable or Semi-Supervised Instance-Optimal Learning

The paper extends the study of relatively smart learning, showing that ERM and any proper consistent learner are relatively smart for binary classification in the distribution‑free setting, achieving a quadratic sample‑complexity blowup. It further demonstrates that semi‑supervised relatively smart learning is possible with only a quadratic blowup in unlabeled data and no blowup in labeled data, though this requires a leave‑most‑out transductive approach and incurs intractability when only an agnostic ERM oracle is available. The results clarify the trade‑offs between sample efficiency, label efficiency, and computational tractability in relatively smart learning.

By Shaddin Dughmi, Alireza F. Pour
arXiv AI
Sep 23

LIMIT: Less Is More for Instruction Tuning in Text-to-SQL

LIMIT (Less Is More for Instruction Tuning in Text-to-SQL) challenges the belief that large instruction corpora are necessary for effective Text-to-SQL models. The framework uses a four‑stage data‑centric process—difficulty‑aware filtering, chain‑of‑thought synthesis, LLM‑as‑judge quality scoring, and genetic algorithm optimization—to select a compact set of examples that still achieve full schema coverage. On the BIRD and Spider benchmarks, LIMIT’s 796 and 863 samples enable Qwen3‑8B to reach 69.1% and 88.9% execution accuracy, outperforming methods trained on twenty times more data and setting a new state‑of‑the‑art for open‑source approaches.

By Haoyuan Ma, Hengwei Liu, Linjuan Wu, Yongliang Shen, Weiming Lu