arXiv Machine Learning

Fractal basins trap latent reasoning

The paper reports that reasoning models in AI exhibit transient chaos, a phenomenon linked to computational complexity. It finds that these models behave as dynamical systems with fractal basins, and that the fractality grows with task difficulty across domains such as Sudoku, maze solving, visual puzzles, and mathematical logic. The study attributes slowdowns to the models becoming trapped near saddle points representing nearly‑correct solutions.

arXiv AI
4d ago

Reasoning with Neural Cellular Automata

The paper investigates Neural Cellular Automata (NCAs), which are networks of recurrent cells that rely on local connectivity and asynchronous updates. It demonstrates that NCAs can solve complex visual reasoning tasks such as large mazes, Sudoku, and ARC-AGI-1, and that they generalize to larger grids, longer rollouts, and parallel trials. The study also shows that training with sample replay and stochastic perturbations enhances generalization, and that NCAs can recover from damage and scale to raw pixel reasoning.

By Mayalen Etcheverry, Pietro Miotti, Aidan Sirbu, Konstantin Sch\"urholt, Mariia Drozdova, Arna Ghosh, Blaise Ag\"uera y Arcas, James Manyika, Blake Richards, Eyvind Niklasson
arXiv AI
Jun 8

DyCon: Dynamic Reasoning Control via Evolving Difficulty Modeling

arXiv:2606. 07108v1 Announce Type: new Abstract: Recent advances in Large Reasoning Models (LRMs) demonstrate remarkable performance improvements by iteratively reflecting, exploring, and executing complex tasks, yet suffer from inefficiencies due to redundant reasoning, known as "overthinking".

By Tengyao Tu, Yulin Li, Hui-Ling Zhen, Libo Qin, Zhoujun Wei, Jinghua Piao, Zhuotao Tian, Yong Li, Min Zhang
arXiv AI
Sep 2

Latent Recurrent Thoughts: Recurrent Refinement of Proposed Latents for Reasoning with Frozen LLMs

Latent Recurrent Thoughts (LRT) proposes a method for reasoning with frozen large language models by operating in the model’s continuous representation space. A small auxiliary network generates initial latent vectors, which a tiny recurrent reasoner refines over multiple steps, decoupling computational depth from model size. Experiments on symbolic and natural‑language reasoning tasks show that LRT outperforms prior frozen‑decoder continuous‑space methods and chain‑of‑thought prompting while using far less inference compute.

By Zhaoliang Chen, Jie Fu
arXiv AI
Jul 22

Fluid Reasoning Representations

arXiv:2602. 04843v2 Announce Type: replace Abstract: Frontier large language models increasingly solve complex tasks involving abstract concepts through extended test-time thinking.

By Dmitrii Kharlapenko, Terry Jingchen Zhang, Arth Singh, Alessandro Stolfo, Arthur Conmy, Mrinmaya Sachan, Zhijing Jin
Hugging Face Trending Papers
Jul 5

Why Pure Reasoning is Not Enough: Nature as the Source of Mathematical Innovation

We advance the hypothesis that human mathematical reasoning, constrained by both the undecidability and the computational intractability of even modest logical fragments, relies fundamentally on pattern matching from domains external to pure deduction. The most prolific reservoir of such patterns is the natural world, whose physical laws and biological systems have undergone billions of years of ``pre-computation'' and already exhibit surprisingly innovative solutions.

arXiv Machine Learning
Aug 26

Steering Recurrent Reasoners at Inference Time with Readout Feedback

arXiv:2608.24136v1 Announce Type: new Abstract: Recurrent models, which repeatedly update latent states with shared computation blocks, have emerged as powerful architectures for solving complex reas...

By Shunsuke Kamiya, Masanori Koyama, Seongcheol Jeong, Fumiya Uchiyama, Kenji Kubo, Kohei Hayashi, Masahiro Suzuki, Yutaka Matsuo