arXiv Computation and Language
2d ago

Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making

The paper introduces Agent-Authored World Modeling (AAWM), a training method that replaces traditional next-observation prediction with decision-oriented supervision. AAWM constructs training targets by having the agent identify what it needs to know before acting, then retrieves relevant transition evidence across trajectories to synthesize these needs into learning signals. Experiments across multiple environments demonstrate that this decision-aware approach yields more effective learning than conventional next-observation prediction.

By Guangfeng Cai, Kaibing Yang, Shuo He, Yu Li, Shengtian Yang, Jiaqi Lv, Lei Feng
arXiv AI
Aug 5

Quo Vadis, World Modeling?

arXiv:2608. 02713v1 Announce Type: cross Abstract: Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize.

By Yu Yang, Xuemeng Yang, Licheng Wen, Lingdong Kong, Xiaobin Hu, Dongyue Lu, Wei Chow, Xiyan Huang, Yuxiang Feng, Yue Liao, Jianbiao Mei, Daocheng Fu, Rong Wu, Pinlong Cai, Ran Yi, Ying Tai, Jiangning Zhang, Botian Shi, Yong Liu, Shuicheng Yan
arXiv Computation and Language
Sep 10

Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspective

arXiv:2510.15047v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) as agents often fail to improve in new environments. We identify and characterize a failure mode we call explora...

By Shiqi Chen, Tongyao Zhu, Zian Wang, Jinghan Zhang, Kangrui Wang, Ruochen Zhou, Siyang Gao, Teng Xiao, Yee Whye Teh, Junxian He, Manling Li
arXiv AI
Oct 28

Vision-Language Agents Can Learn in Their Own Latent Worlds

The paper introduces Dwell, a model‑based reinforcement learning framework that treats a pretrained vision‑language model (VLM) as a recurrent latent transition operator. Dwell enables the VLM to predict, adjust, and act within its own latent space, allowing the agent to learn from real interactions and latent imagination without reconstructing full futures. Experiments across five interactive visual environments show that Dwell outperforms other trainable methods while significantly reducing computational demands for imagination.

By Haoxi Li, Sikai Bai, Jianfei Ma, Qinglin Hou, Xiaocheng Lu, Tao Han, Jie Zhang, Song Guo