arXiv Machine Learning July 23, 2026 By Aras Kavuncu, Bryan Vullo, Alberto Berni

Reproducing Recurrent Transformers: The CoTFormer

Read the original on arXiv Machine Learning →

arXiv:2607. 19405v1 Announce Type: new Abstract: The CoTFormer architecture formalizes Chain-of-Thought as a form of recurrent latent computation, preserving intermediate states as attendable representations to mimic explicit reasoning traces.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.

llms

arXiv AI

Jul 17

T^2MLR: Transformer with Temporal Middle-Layer Recurrence

arXiv:2607. 15178v1 Announce Type: cross Abstract: Transformer reasoning is limited by autoregressive decoding, which repeat edly compresses rich hidden computation through token space and makes it difficult for intermediate reasoning states to persist across time.

By Ziyang Cai, Xingyu Zhu, Yihe Dong, Yinghui He, Sanjeev Arora

llms fine-tuning

arXiv AI

Jul 29

Penelope: Localized Latent Recurrence for Efficient Structured Reasoning

arXiv:2607. 25915v1 Announce Type: new Abstract: Complex structured reasoning tasks often require additional computation, yet current language models obtain it mainly by increasing parameter scale or by serializing intermediate steps as chain-of-thought (CoT) tokens.

By Yutong Chen, Shouqian Shi, Xinran Liu, Haochen Wang, Jiaying Wang, Tianxing Xu, Yuanxi Wang, Zirui Ding

llms diffusion efficiency benchmarks

arXiv Machine Learning

Jul 1

Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers

arXiv:2606. 31779v1 Announce Type: new Abstract: Language models typically reason via explicit chain-of-thought (CoT), generating intermediate steps token-by-token.

By Ying Fan, Anej Svete, Kangwook Lee

llms diffusion

arXiv Computation and Language

Sep 1

Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning

arXiv:2505.16782v3 Announce Type: replace Abstract: Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT...

By Xinghao Chen, Anhao Zhao, Heming Xia, Xuan Lu, Hanlin Wang, Yanjun Chen, Wei Zhang, Jian Wang, Wenjie Li, Xiaoyu Shen

llms nlp

arXiv AI

Aug 11

Think Deep, Speak Once: Relit, A Recursive Latent Implicit Transformer Framework

arXiv:2608. 08113v1 Announce Type: new Abstract: Chain-of-Thought (CoT) prompting has become the dominant paradigm for eliciting reasoning in Large Language Models (LLMs), yet it creates substantial computational overhead by forcing models to externalize intermediate reasoning steps as discrete tokens.

By Abhishek Panwar, Maheep Singh, Saksham Bansal

llms benchmarks

arXiv AI

Aug 12

Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformers

arXiv:2604. 07822v2 Announce Type: replace-cross Abstract: We study implicit reasoning, i.

By Harsh Kohli, Srinivasan Parthasarathy, Huan Sun, Yuekun Yao

llms

One email a morning, machine-written

Related stories

T^2MLR: Transformer with Temporal Middle-Layer Recurrence

Penelope: Localized Latent Recurrence for Efficient Structured Reasoning

Bridging the Gap Between Latent and Explicit Reasoning with Looped Transformers

Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning

Think Deep, Speak Once: Relit, A Recursive Latent Implicit Transformer Framework

Loop, Think, & Generalize: Implicit Reasoning in Recurrent-Depth Transformers