arXiv Machine Learning

Learning Deterministic Finite-State Machines from the Prefixes of a Single String is NP-Complete

arXiv:2601. 12621v2 Announce Type: replace-cross Abstract: It is well known that computing a minimum deterministic finite automaton consistent with a given set of positive and negative examples is NP-hard.

arXiv AI
Jun 30

Machine-learnable Sets

arXiv:2606. 28947v1 Announce Type: cross Abstract: In this study we present a formal definition of large discrete sets having, informally, three properties: their elements are easily recognized, easily generated, and the latter tasks are easily learned from examples.

By Veit Elser, Manish Krishan Lal
arXiv AI
Jul 28

Invariant Discovery for Networked Systems

arXiv:2607. 22944v1 Announce Type: cross Abstract: Invariants, the relations expected to hold among measured signals of a network, underpin applications from verification to traffic generation, telemetry imputation, and input validation, yet writing them by hand demands rare expertise in both formal logic and networking.

By Hongyu H\`e, Alexander Krentsel, Sylvia Ratnasamy, Maria Apostolaki
arXiv Machine Learning
Jul 15

Language Identification with Succinct Machine-Independent Traces

arXiv:2607. 12443v1 Announce Type: cross Abstract: Motivated by the power of large language models, there has been renewed interest in the Gold-Angluin model of language identification in the limit, with an eye toward variants of the model that might overcome the negative results for its original formulation.

By Moses Charikar, Jon Kleinberg, Chirag Pabbaraju
arXiv Machine Learning
2d ago

Sequence prediction under a lying oracle

arXiv:2608. 14102v1 Announce Type: new Abstract: We consider the problem of sequential prediction of an $m$-ary sequence, where at each epoch, (i) the environment selects an outcome from an $m$-ary alphabet, (ii) the learner selects a probability distribution over the same alphabet (unaware of the outcome generated by the environment), and finally, (iii) the learner incurs a cost that depends on the probability assigned to the outcome.

By Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan Nair
arXiv Machine Learning
Jun 2

Length Generalization Bounds for Transformers

arXiv:2603. 02238v2 Announce Type: replace Abstract: Length generalization is a key property of a learning algorithm that enables it to make correct predictions on inputs of any length, given finite training data.

By Andy Yang, Pascal Bergstr\"a{\ss}er, Georg Zetzsche, David Chiang, Anthony W. Lin
arXiv Machine Learning
Jun 25

Space-Efficient Language Generation in the Limit

arXiv:2606. 25777v1 Announce Type: cross Abstract: We initiate a resource-aware theory of \textit{language generation in the limit} under the minimal constraint of space efficiency.

By Nicolas Flammarion, Chirag Pabbaraju, Hristo Papazov, Miltiadis Stouras, Ola Svensson