Principled Thoughts for Latent Recursive LLM Systems

The paper introduces REST (REpresentation‑Supervised Thoughts), a new training objective for latent recursive language‑model systems that supplements cross‑entropy loss with differentiable penalties enforcing causality, minimality, separability, and stability of internal thought representations. By applying REST to both single‑agent and multi‑agent setups without changing architectures or adding inference parameters, the authors achieve up to 7.5 percentage‑point gains in accuracy across seven diverse benchmarks and a 30 % improvement in convergence to the final answer. The method also yields more informative latent thoughts, improving interpretability of agent communication.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

• llms
• agents
• benchmarks