arXiv Machine Learning By Rakesh Sengupta

A Reverse-Gold Theorem: Positive-Data Identification by Substrate-Bounded Contrastive Learners

Read the original on arXiv Machine Learning →

The paper presents a positive result contrasting Gold’s theorem by showing that a learner equipped with a recursive contrast operator and a bounded-capacity InfoNCE-style scorer can achieve PAC conditional identification from positive data alone. Under a faithfulness condition, the trained scorer ranks almost all positives above any out-of-language perturbation within their orbit, with polynomial sample complexity in the operator’s capacity, orbit size, score bound, and error tolerance. The method constructs negatives internally, avoids global normalization, and extends to a membership classifier and a normalization-free Metropolis–Hastings generator, with instantiations for substitutable context‑free and subregular languages. whyItMatters":"The work demonstrates that contrastive learning can overcome classical limits on language identification by positive data, offering a concrete, sample‑efficient framework for learning structured language classes without external negative examples."

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

arXiv Machine Learning
Jun 25

Space-Efficient Language Generation in the Limit

arXiv:2606. 25777v1 Announce Type: cross Abstract: We initiate a resource-aware theory of \textit{language generation in the limit} under the minimal constraint of space efficiency.

By Nicolas Flammarion, Chirag Pabbaraju, Hristo Papazov, Miltiadis Stouras, Ola Svensson
arXiv AI
Aug 12

On Solomonoff Induction in Large Language Models and the Limits of Self-Improving: The Singularity Is Not Near Without Symbolic Model Synthesis

arXiv:2601. 05280v3 Announce Type: replace-cross Abstract: On the one hand, the question of whether large language models (LLMs) are Solomonoff induction estimators has become an explicit question at the intersection of Algorithmic Information Theory (AIT) and Machine Learning (ML) of great interest.

By Hector Zenil