The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.
By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen
EvoBelief is a self‑evolving world model that represents environment knowledge as falsifiable hypotheses, allowing an LLM agent to update its beliefs during deployment. The system generates hypotheses when unexpected outcomes or unknowns arise, validates them through observations and controlled experiments, and then uses the confirmed rules to guide predictions or plans. Across benchmarks such as ALFWorld, MiniGrid, and DiscoveryWorld, EvoBelief improves task performance, revises stale rules, and discovers quantitative laws, outperforming baseline frozen world models.
By Janet Wang, Jiang Guo, Yi Xiang, Jiaqing Yuan, Mingwen Dong, Hideo Kobayashi, Shuaichen Chang, Chandan K. Reddy, Jiarong Jiang
Memento 3 is a frozen large‑language‑model agent that learns explicit world models by maintaining a natural‑language rulebook in external memory. The agent iteratively observes, reflects, revises the rulebook, compiles it into executable code, and verifies updates through prediction error and replay, accepting only code that the LLM deems faithful to the rulebook. In experiments, a single‑model version solved all 25 public ARC‑AGI‑3 games with perfect efficiency, and a learned feedback controller achieved perfect scores in Atari Pong without further LLM calls.
By Haoyu Zhao, Zhengxu Yu, Zhiyuan He, Meng Fang, Rasul Tutunov, Haitham Bou-Ammar, Weilin Luo, Jun Wang
arXiv:2610.17757v1 Announce Type: new
Abstract: Large language model agents can follow complex human instructions to solve real-world tasks. In practice, however, initial instructions are often incom...
By Kaiming Liu, Yuxuan Liu, Jinrui Ju, Minyuan Ruan, Xuanyu Lei, Peng Li, Yang Liu
The paper investigates how a coding agent learns across a sequence of abstract reasoning tasks in the ARC-AGI-3 benchmark. The agent, operating on a frozen foundation model, writes and runs Python and shell scripts, retaining only its written artifacts as state. The authors develop a measurement protocol that traces each thought—any belief, rule, or plan committed to a file—through its lifecycle, revealing that most task-specific scripts are discarded at task boundaries and that the agent selectively forgets by rewriting knowledge into new scripts while accumulating unedited notes.
By Chen Wu, Josh Passenger, Yin Song
arXiv:2610.09624v1 Announce Type: cross
Abstract: Tool calling, invoking external tools on demand, is central to agentic LLMs, yet the mechanism that decides whether a model calls a tool or responds...
By Xijie Gong, Tingxu Han, Jiahao Zhang, Wei Song, Ziqi Ding, Hanqi Yan, Youcheng Sun, Lijie Hu
arXiv:2607. 20531v1 Announce Type: new Abstract: Large language model (LLM) agents are increasingly deployed over Model Context Protocol (MCP) servers, yet the benchmarks used to evaluate them score the final answer or a fixed "ground-truth" list of tools, both of which are fragile once the underlying data is live and stateful.
By Jerzy Kami\'nski, Ilya Galyukshev, Artem Kuznetsov, Sergey Chuprin, Kirill Redko, Aidar Shumbalov, Anna Kalyuzhnaya
CoMAP introduces a framework that jointly evolves textual world models and agent policies through a closed‑loop interaction. At each decision step the world model forecasts future state feedback for candidate actions, while the agent reflects on the reliability of this feedback to refine its action. The resulting on‑policy trajectories are used to self‑distill and update the world model, improving prediction accuracy and long‑horizon decision‑making across embodied planning, web navigation, and tool‑use benchmarks.
By Youwei Liu, Jian Wang, Hanlin Wang, Wenjie Li
arXiv:2609.01600v1 Announce Type: cross
Abstract: Dynamic agent harnesses let language models change the software that shapes their own execution. This flexibility brings a new reasoning burden: a lo...
By Damien Sileo, Dimitri Kachler
arXiv:2606. 02372v1 Announce Type: new Abstract: Equipping language agents with world models enables them to anticipate environment dynamics and evaluate candidate actions before execution.
By Youwei Liu, Jian Wang, Hanlin Wang, Wenjie Li
StateTape introduces a new framework for long‑horizon coding agents that rewrites the agent’s context as the code repository changes, rather than letting the context grow with every observation. It models the repository as a symbol‑level code graph, using a tape to mark symbols altered by each write and a manager model to resolve stale records. The authors provide theoretical analysis, a new benchmark called TraceBench, and empirical results showing higher resolve rates across six agents and three edit‑heavy benchmarks with minimal computational overhead.
By Ziyang Yu, Liang Zhao, Bowen Zhu, Hasibul Haque
arXiv:2605. 30880v4 Announce Type: replace-cross Abstract: World models for interactive text agents must typically be learned from observation-action trajectories alone.
By Jiaxin Bai, Yue Guo, Yifei Dong, Jiaxuan Xiong, Tianshi Zheng, Yixia Li, Tianqing Fang, Yufei Li, Yisen Gao, Haoyu Huang, Zhongwei Xie, Hong Ting Tsang, Zihao Wang, Lihui Liu, Jeff Z. Pan, Yangqiu Song