Hugging Face Trending Papers June 26, 2026

From Tokens to States: LLMs as a Special Case of World Models and the Continuous Path Beyond

Read the original on Hugging Face Trending Papers →

The AI community has framed the relationship between large language models (LLMs) and world models as a dichotomy: LLMs predict tokens; world models simulate reality. Yann LeCun argues in 2022 that reaching general intelligence requires abandoning autoregressive token prediction in favour of latent-space architectures.

Summary generated by The Flow from the publisher's feed. The full article lives at Hugging Face Trending Papers.

llms

arXiv AI

Jun 29

From Tokens to States: LLMs as a Special Case of World Models and the Continuous Path Beyond

arXiv:2606. 28127v1 Announce Type: cross Abstract: The AI community has framed the relationship between large language models (LLMs) and world models as a dichotomy: LLMs predict tokens; world models simulate reality.

By Paul Dubois

llms

arXiv Machine Learning

Jun 16

Next-Latent Prediction Transformers Learn Compact World Models

arXiv:2511. 05963v4 Announce Type: replace Abstract: Transformers replace recurrence with a memory that grows with sequence length and self-attention that enables ad-hoc lookups over past tokens.

By Jayden Teoh, Manan Tomar, Kwangjun Ahn, Edward S. Hu, Tim Pearce, Pratyusha Sharma, Akshay Krishnamurthy, Riashat Islam, Alex Lamb, John Langford

llms diffusion benchmarks safety

arXiv AI

Jun 10

One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability

arXiv:2606. 09936v1 Announce Type: cross Abstract: World models are now built on substantially different computational substrates.

By Bhavith Chandra Challagundla, Sanskar Pandey, Param Thakkar, Rishikesh Mallagundla, Yugandhar Reddy Gogireddy, Wenhao Lu, Hindol Roy Choudhury, Shravani Challagundla, Mohamed Deraz Nasr, Spursh Deshpande

llms rag diffusion safety

arXiv AI

Jul 28

Extracting Algorithms in Pre-trained LLMs: A Case on Hidden Markov Models

arXiv:2607. 22646v1 Announce Type: new Abstract: Large language models (LLMs) display a striking ability to predict next observations from Hidden Markov Models (HMMs) via in-context learning (ICL), but the algorithm underlying this capability remains undetermined: prior work has proposed several candidates without consensus, and none has been grounded in the model's internal activations.

By Yijia Dai, Zhaolin Gao, Yahya Sattar, Jennifer J. Sun, Sarah Dean

llms

arXiv Machine Learning

Jun 29

Textual Belief States for World Models: Identifiable Representation Learning Under Strict Mediation

arXiv:2606. 27681v1 Announce Type: new Abstract: World models in partially observed environments rely on latent representations that summarize interaction history, but in many modern LLM-based architectures predictive performance fails to reflect representation quality due to history bypass, rendering the latent state unidentifiable.

By Xiang Gao, Kaiwen Dong, Yuguang Yao, Padmaja Jonnalagedda, Kamalika Das

llms reinforcement-learning

arXiv AI

Jun 4

Scaling Self-Evolving Agents via Parametric Memory

arXiv:2606. 04536v1 Announce Type: new Abstract: Existing memory-augmented LLM agents store past experience exclusively in prompt space, as textual summaries or retrieved passages, while keeping model parameters frozen throughout a rollout.

By Tao Ren, Weiyao Luo, Hui Yang, Rongzhi Zhu, Xiang Huang, Yuchuan Wu, Bingxue Chou, Jieping Ye, Jiafeng Liang, Yongbin Li, Yijie Peng

llms agents reinforcement-learning fine-tuning

Related stories

From Tokens to States: LLMs as a Special Case of World Models and the Continuous Path Beyond

Next-Latent Prediction Transformers Learn Compact World Models

One Lens, Many Worlds : A Capability-Typed Interface for World-Model Interpretability

Extracting Algorithms in Pre-trained LLMs: A Case on Hidden Markov Models

Textual Belief States for World Models: Identifiable Representation Learning Under Strict Mediation

Scaling Self-Evolving Agents via Parametric Memory