arXiv Computation and Language By Nikola Zubi\'c, Qian Li, Yuyi Wang, Davide Scaramuzza

When Does Tool Use Increase the Expressive Power of Finite-Precision Recurrent Models?

Read the original on arXiv Computation and Language →

The paper investigates how access to external tools affects the computational expressivity of finite‑precision recurrent models. It shows that any finite‑state bounded‑interface tool can be internalized with only a logarithmic increase in recurrent bits, while a single unbounded tape with simple read/write/move commands suffices for Turing completeness, enabling a single‑layer selective affine state‑space model to simulate any Turing machine with only logarithmic recurrent bits. The study provides exact separations between tool‑augmented and tool‑free regimes under deterministic semantics.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Machine Learning
Sep 10

Compressed Recurrent Feedback in Tsetlin Machines: A Reproducible Boolean-FSM Study

The paper proposes a fixed‑width recurrent feedback scheme for Recurrent Tsetlin Machines (RTMs) by folding clause activations with XOR, retaining the folded bits at two time scales, and thresholding them back to binary. This compression reduces 480 clause activations to 96 recurrent bits while achieving comparable accuracy (61.47 ± 6.74% and 62.94 ± 9.92%) on a reproducible Boolean finite‑state‑machine benchmark across 144 runs. The study shows that raw clause feedback offers only marginal accuracy gains but increases recurrent width and execution time significantly, and highlights the importance of no‑feedback controls in sequence model benchmarking.

By Ankit Kumar, Utkarsh Raj, Rishad Shafik, Sudip Roy
arXiv AI
Jun 19

Efficiently Representing Algorithms With Chain-of-Thought Transformers

arXiv:2606. 19697v1 Announce Type: cross Abstract: The increasing popularity of \emph{reasoning} models -- language models that output a series of reasoning or thought tokens before producing an answer -- is justified, in part, by theoretical results showing that chain-of-thought (CoT) transformers can simulate Turing machines, and thus perform arbitrary computation.

By Yanhong Li, Anej Svete, Ashish Sabharwal, William Merrill
arXiv Machine Learning
Oct 5

Harnessing LLMs as Agents: What Does It Cost?

The paper introduces the Language Model Agent Machine (LAM), a framework that quantifies the computational resources consumed by language‑model agents’ harnesses—such as bounded context, memory, tools, and verification. It presents four main theoretical results: (1) communication costs mapped to pebbling lower bounds, (2) memory‑access separations revealing a linear gap between random and non‑speculative access, (3) recomputation bounds for bit‑reversal DAGs that show when storing intermediate state is beneficial, and (4) reliability bounds that yield optimal verification intervals. Experiments on GPT‑6 Astra validate the theory’s predictions for communication, reliability, and trade‑offs in practical tasks.

By Zelin Zhao (Georgia Institute of Technology), Xinyu Guo (Georgia Institute of Technology), Jingyuan Zhang (Georgia Institute of Technology), Yuxuan Zhang (Etude AI), Yongxin Chen (Georgia Institute of Technology)