arXiv AI

Reasoning with Neural Cellular Automata

The paper investigates Neural Cellular Automata (NCAs), which are networks of recurrent cells that rely on local connectivity and asynchronous updates. It demonstrates that NCAs can solve complex visual reasoning tasks such as large mazes, Sudoku, and ARC-AGI-1, and that they generalize to larger grids, longer rollouts, and parallel trials. The study also shows that training with sample replay and stochastic perturbations enhances generalization, and that NCAs can recover from damage and scale to raw pixel reasoning.

arXiv AI
Sep 2

Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners

Flow Reasoning Models (FRMs) are a new framework that turns continuous flow models into efficient recurrent reasoners for structured tasks. By self‑conditioning a flow model on its own past outputs, FRMs iteratively refine solutions, allowing parallel decision making and revision. The authors introduce Fixed‑Point Forcing (FPF) to mitigate exposure bias at deeper recursion, and report near‑perfect solve rates on Sudoku‑Extreme, Zebra, and Maze‑Unique, outperforming existing masked‑diffusion and specialized baselines while using far fewer inference FLOPs.

By Alec Helbling, Andrey Bryutkin, Mauro Martino, Duen Horng Chau, Nima Dehmamy, Hendrik Strobelt
arXiv Machine Learning
Sep 7

Fractal basins trap latent reasoning

The paper reports that reasoning models in AI exhibit transient chaos, a phenomenon linked to computational complexity. It finds that these models behave as dynamical systems with fractal basins, and that the fractality grows with task difficulty across domains such as Sudoku, maze solving, visual puzzles, and mathematical logic. The study attributes slowdowns to the models becoming trapped near saddle points representing nearly‑correct solutions.

By Jeffrey Lai, Anthony Bao, John Quinn, William Gilpin
arXiv AI
3d ago

Hierarchical Reasoning Model

arXiv:2506.21734v4 Announce Type: replace Abstract: Reasoning, the process of devising and executing complex goal-oriented action sequences, remains a critical challenge in AI. Current large language...

By Guan Wang, Jin Li, Yuhao Sun, Xing Chen, Changling Liu, Yue Wu, Meng Lu, Sen Song, Yasin Abbasi Yadkori
arXiv Machine Learning
Aug 26

Steering Recurrent Reasoners at Inference Time with Readout Feedback

arXiv:2608.24136v1 Announce Type: new Abstract: Recurrent models, which repeatedly update latent states with shared computation blocks, have emerged as powerful architectures for solving complex reas...

By Shunsuke Kamiya, Masanori Koyama, Seongcheol Jeong, Fumiya Uchiyama, Kenji Kubo, Kohei Hayashi, Masahiro Suzuki, Yutaka Matsuo
arXiv AI
Jun 30

Flow Reasoning Models: Scaling Reasoning Through Iterative Self-Refinement

arXiv:2606. 29150v1 Announce Type: new Abstract: Discrete flow models have recently shown promising performance on few-step text generation; however, when naively applied to structured reasoning tasks such as Sudoku and Zebra puzzles, they converge confidently to incorrect answers (solving only $\sim$36% of Sudoku puzzles).

By Alec Helbling, Andrey Bryutkin, Mauro Martino, Nima Dehmamy, Hendrik Strobelt
arXiv AI
Aug 3

Demystifying Video Reasoning

arXiv:2603. 16870v3 Announce Type: replace-cross Abstract: Recent advances in video generation have revealed an unexpected phenomenon: diffusion-based video models exhibit non-trivial reasoning capabilities.

By Ruisi Wang, Zhongang Cai, Fanyi Pu, Junxiang Xu, Wanqi Yin, Maijunxian Wang, Ran Ji, Chenyang Gu, Bo Li, Ziqi Huang, Hokin Deng, Dahua Lin, Ziwei Liu, Lei Yang