arXiv AI
Geometry of Divergence: Tracking Hidden-State Trajectories for Adaptive Multi-Turn Reasoning
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Oct 9
When Should Agents Think? Adaptive Reasoning via Cross-Turn Estimation
Large language model agents often reason before every action, but this may be unnecessary if earlier reasoning still supports later actions. The paper introduces RACE, a method that uses likelihood-based signals to detect when reasoning can be omitted, called LoGiC. Experiments on four benchmarks show RACE cuts reasoning cost while keeping or improving performance.
arXiv Machine Learning
Sep 30
Act First, Reason Later: Accelerating On-Policy Distillation for Multi-Turn Agents via Reference-Conditioned Inverse Dynamics
arXiv:2609.36608v1 Announce Type: new Abstract: On-policy distillation (OPD) trains multi-turn language agents with dense teacher supervision on student-generated responses. However, standard think-t...
arXiv Computation and Language
5d ago
Monitoring the Internal Monologue: Probe Trajectories Reveal Reasoning Dynamics
The paper investigates how monitoring the internal representations of Large Reasoning Models (LRMs) during their Chain-of-Thought (CoT) reasoning can predict future behavior. By evaluating a probe at each generated token, the authors construct probe trajectories that capture the continuous evolution of a concept’s probability, and extract signal‑processing features to characterize volatility, trend, and steady‑state behavior. These trajectory features improve predictive performance over static probes, adding an average of 21.7 AUROC points, and the study demonstrates that template‑based training data and pooling operations are essential for effective monitoring across multiple reasoning models and datasets.
arXiv Machine Learning
Jul 3
Geometric Signatures of Reasoning: A Spectral Perspective on Task Hardness
arXiv:2607. 01571v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning enables large language models (LLMs) to solve complex problems by generating intermediate reasoning steps.
arXiv AI
Sep 10
Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning
arXiv:2609.09030v1 Announce Type: new Abstract: Chain-of-thought reasoning provides a structured computation between a model's input and final answer. Yet it is often evaluated through endpoint accur...
arXiv AI
Jun 2
Bridging Reasoning Trajectories in On-Policy Distillation via Near-Future Guidance
arXiv:2606. 00305v1 Announce Type: cross Abstract: On-Policy Distillation (OPD) improves large language model reasoning by training a student model on trajectories sampled from its own policy under teacher supervision.