The paper introduces AlgoTrace, a framework that traces and steers algorithmic operations in large language models’ latent space during multi‑step reasoning. By clustering latent activations on tasks such as TSP, 3SAT, AIME, and Graph Navigation, the authors identify reusable primitive vectors that can be injected to elicit specific algorithmic behaviors, composed algebraically, and transferred across models and tasks. Fine‑tuning further improves the composition of these primitives, suggesting that LLM reasoning can be viewed as a walk through algorithmic primitives governed by compositional geometry.
By Samuel Lippl, Thomas McGee, Kimberly Lopez, Ziwen Pan, Pierce Zhang, Salma Ziadi, Oliver Eberle, Ida Momennejad
arXiv:2605. 16385v3 Announce Type: replace-cross Abstract: Geometric problem solving, as a typical multimodal reasoning problem, has attracted much attention and made great progress recently, however most of works focus on plane geometry while usually fail in solid geometry due to 3D spatial diagrams and complex reasoning.
By Ruoran Xu, Haoyu Cheng, Bin Dong, Qiufeng Wang
arXiv:2603. 04852v2 Announce Type: replace Abstract: Multi-step theorem prediction is a central challenge in geometry problem solving.
By Junbo Zhao, Ting Zhang, Can Li, Wei He, Jingdong Wang, Hua Huang
arXiv:2606. 04381v1 Announce Type: cross Abstract: Recent large language models (LLMs) often appear to exhibit spatial reasoning ability; however, this capability is largely \emph{symbolic}, arising from pattern matching over spatial language rather than true \emph{geometric} reasoning over space.
By Chen Chu, Bita Azarijoo, Li Xiong, Khurram Shafique, Cyrus Shahabi
arXiv:2606. 27967v1 Announce Type: new Abstract: Real-world knowledge graphs are often incomplete, lacking many valid facts.
By Yike Liu, Peijia Xie, Chao He, Huiling Zhu
arXiv:2607. 13454v1 Announce Type: cross Abstract: Although multimodal large language models (MLLMs) have achieved remarkable progress, understanding 3D spatial relationships from 2D images remains a critical challenge.
By Hao Li, Han Fang, Zixin Pan, Xin Wei, Hongbo Sun, Jinglin Xu, Zhiyu Lin, Ye Yuan, Zhongjiang He, Yu Yu, Hao Sun