arXiv Machine Learning

Learning Deterministic Finite-State Machines from the Prefixes of a Single String is NP-Complete

arXiv:2601. 12621v2 Announce Type: replace-cross Abstract: It is well known that computing a minimum deterministic finite automaton consistent with a given set of positive and negative examples is NP-hard.

arXiv AI
Jun 30

Machine-learnable Sets

arXiv:2606. 28947v1 Announce Type: cross Abstract: In this study we present a formal definition of large discrete sets having, informally, three properties: their elements are easily recognized, easily generated, and the latter tasks are easily learned from examples.

By Veit Elser, Manish Krishan Lal
arXiv Machine Learning
Sep 24

SMT-Based Active Learning of Weighted Automata

The paper introduces an SMT-based active learning algorithm for nondeterministic weighted finite automata (WFAs), offering a practical alternative to traditional Hankel/L*-style methods. The algorithm is parametric over a chosen semiring and, upon termination, guarantees the production of minimal WFAs. Experiments demonstrate that it learns numerous minimal WFAs over both finite and infinite semirings, outperforming a naive baseline and competing with state‑of‑the‑art algorithms while yielding smaller automata and requiring less teacher interaction.

By Tiago Ferreira, Kevin Batz, Alexandra Silva
arXiv Machine Learning
Aug 20

Learning Canonical Register Automata over Ordered Data Domains

The paper presents a polynomial‑time active learning procedure for deterministic register automata (DRAs) over ordered data domains, covering both dense domains like the rationals and non‑dense domains such as the integers. It unifies the learning framework for these domains using membership, equivalence, and memorability queries, and shows that minimization of DRAs over the integer domain is decidable. Additionally, the authors provide improved complexity bounds for several decision problems related to DRAs over ordered domains.

By Yong Li, Qiyi Tang, Di-De Yen
arXiv Machine Learning
Jul 15

Language Identification with Succinct Machine-Independent Traces

arXiv:2607. 12443v1 Announce Type: cross Abstract: Motivated by the power of large language models, there has been renewed interest in the Gold-Angluin model of language identification in the limit, with an eye toward variants of the model that might overcome the negative results for its original formulation.

By Moses Charikar, Jon Kleinberg, Chirag Pabbaraju
arXiv Computation and Language
Aug 28

Stochastic Estimation of Transduced Language Models

Transduced language models (TLMs) combine a pretrained source language model with a finite‑state transducer to produce a language model over target strings. The paper introduces an unbiased stochastic estimator that resamples source prefixes without replacement and reweights them, allowing accurate estimation of target prefix probabilities while reducing computation compared to threshold‑pruned beam summing. Experiments on encyclopedic text, DNA, and DNA‑to‑amino‑acid transduction show improved compute–variance trade‑offs and significant runtime reductions, and the method also lowers estimated corpus surprisal in a reading‑time analysis without altering its conclusions.

By V\'esteinn Sn{\ae}bjarnarson, Samuel Kiegeland, Manuel de Prada Corral, Ryan Cotterell, Tim Vieira
arXiv Machine Learning
Sep 10

Length Generalization for Transformers via Compression

arXiv:2609.08851v1 Announce Type: new Abstract: Recent advancements in transformer length generalization theory enable us to reliably predict when a transformer can learn to solve a task. In particul...

By Georg Zetzsche, Hongjian Jiang, Andy Yang, Pascal Bergstr\"a{\ss}er, Marco S\"alzer, David Chiang, Anthony W. Lin
arXiv AI
Jul 24

Identifying Good Rules for Efficient SAT Encodings of Single-Constant Multiplication Using Machine Learning

arXiv:2607. 21188v1 Announce Type: new Abstract: The Single Constant Multiplication problem is a fundamental NP-hard optimization task in hardware design, which seeks to decompose a fixed constant using only additions, subtractions, and bit-shifts.

By Chufeng Jiang (Graduate Center, The City University of New York), Neng-Fa Zhou (Graduate Center, The City University of New York)
arXiv Machine Learning
Aug 17

Sequence prediction under a lying oracle

arXiv:2608. 14102v1 Announce Type: new Abstract: We consider the problem of sequential prediction of an $m$-ary sequence, where at each epoch, (i) the environment selects an outcome from an $m$-ary alphabet, (ii) the learner selects a probability distribution over the same alphabet (unaware of the outcome generated by the environment), and finally, (iii) the learner incurs a cost that depends on the probability assigned to the outcome.

By Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan Nair