arXiv Statistics ML

RL unknotter, hard unknots and unknotting number

arXiv AI
Oct 2

HyperGuide: Hyperbolic Guidance for Efficient Multi-Step Reasoning in Large Language Models

HyperGuide introduces a hyperbolic geometric signal to guide multi-step reasoning in large language models, addressing the trade-off between efficient single-pass generation and computationally heavy tree-search methods. By projecting LLM hidden states into hyperbolic space, the approach leverages the space’s asymmetry—compact near the origin and exponentially expanding toward the boundary—to encode solution proximity and branch differentiation. A lightweight head and a fine-tuned low-rank adapter use this signal to improve reasoning accuracy, especially on deeper reasoning chains, with consistent gains across multiple benchmarks.

By Yuyu Liu, Haotian Xu, Yanan He, Sarang Rajendra Patil, Mengjia Xu, Tengfei Ma
arXiv AI
Oct 2

New Snake-in-the-Box Records via Snakepit Surgery and Learned Construction

The paper reports a new record for the snake-in-the-box problem, presenting a length‑191 snake in the 9‑dimensional hypercube, surpassing the previous 190‑length record that had stood for 14 years. It also establishes new lower bounds for dimensions 10 through 13. The authors introduce a novel search technique called snakepits, which expands the search space by considering collections of disjoint snakes, and propose a new benchmark, Snakepit‑in‑the‑Box, that evaluates maximal edge counts across multiple components. Additionally, they present Beam Anchor, a learned construction algorithm that generates 100 inequivalent length‑190 snakes in dimension 9.

By Paul Orland, Lucas Fagan, Michele Tarquini, Davide Passaro, Maksymilian Manko, Elli Heyes, Angus Gruen, Giorgi Butbaia, Justin Tan, Sergei Gukov
arXiv AI
Aug 11

How Much Backtracking is Enough? Exploring the Interplay of SFT and RL in Enhancing LLM Reasoning

arXiv:2505. 24273v2 Announce Type: replace Abstract: Recent advancements in large language models (LLMs) suggest that reinforcement learning (RL) effectively internalizes search strategies, yielding significant improvements on challenging reasoning tasks through extended chains of thought.

By Hongyi James Cai, Junlin Wang, Xiaoyin Chen, Bhuwan Dhingra
arXiv Machine Learning
Aug 27

Imitation Learning for Connection-Tableau Construction

The paper presents an approach to automated theorem proving by framing the construction of clausal connection tableaux as a policy in a transition system. It introduces a graph neural network that scores proof edits based on structure, trained via imitation learning from existing proofs. Experiments on M2k, MPTP2078-bushy, and TPTP v9.2.1 show that the learned policies solve up to 46% more problems than leanCoP and find proofs in an order of magnitude fewer steps.

By Fredrik R{\o}mming, Mantas Bak\v{s}ys, Martin S. Fixman, Sean B. Holden
Hugging Face Trending Papers
Jun 22

Provable Benefits of RLVR over SFT for Reasoning Models: Learning to Backtrack Efficiently

Recent advances in large language models (LLMs) have demonstrated that reinforcement fine-tuning of pretrained base models can lead to significant gains in reasoning performance at inference time. In this work, we theoretically analyze why reinforcement fine-tuning induces better reasoning ability than purely supervised fine-tuning (SFT) methods.