Hugging Face Trending Papers
Aug 3

Quo Vadis, World Modeling?

Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize. World modeling offers a natural intermediate proxy that allows agents to query lower-cost, more controllable feedback before committing to real actions.

arXiv AI
Aug 3

Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learning

arXiv:2511. 22226v2 Announce Type: replace Abstract: The standard theory of model-free reinforcement learning assumes that the environment dynamics are stationary and that agents are decoupled from their environment, such that policies are treated as being separate from the world they inhabit.

By Alexander Meulemans, Rajai Nasser, Maciej Wo{\l}czyk, Marissa A. Weis, Seijin Kobayashi, Blake Richards, Guillaume Lajoie, Angelika Steger, Marcus Hutter, James Manyika, Rif A. Saurous, Jo\~ao Sacramento, Blaise Ag\"uera y Arcas
arXiv AI
Aug 5

Quo Vadis, World Modeling?

arXiv:2608. 02713v1 Announce Type: cross Abstract: Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize.

By Yu Yang, Xuemeng Yang, Licheng Wen, Lingdong Kong, Xiaobin Hu, Dongyue Lu, Wei Chow, Xiyan Huang, Yuxiang Feng, Yue Liao, Jianbiao Mei, Daocheng Fu, Rong Wu, Pinlong Cai, Ran Yi, Ying Tai, Jiangning Zhang, Botian Shi, Yong Liu, Shuicheng Yan
arXiv AI
4d ago

Environment Evolution for Terminal Agents

The paper introduces "environment evolution," a method that incrementally raises the difficulty of interactive environments off‑policy, scheduling their generation across training generations to supply continuous learning signals. It derives three evolution directions tied to a multi‑turn learning objective and implements them via a loop‑engineered multi‑agent harness. Experiments with models such as Hy4 preview, Claude Opus 5, GPT‑5.6 Sol, Qwen3.6‑27B, and Qwen3.6‑35B‑A3B demonstrate that this approach consistently creates harder environments and boosts terminal‑agent performance on Terminal‑Bench 2.1 by 14.4–18.0 percentage points.

By Zhiyuan Fan, Tinghao Yu, Yuanjun Cai, Jiang Zhou, Jiangtao Guan, Jincheng Liu, Yun Yang, Dingxin Hu, Zhuo Han, Xing Wu, Feng Zhang, Lilin Wang
Hugging Face Trending Papers
5d ago

Environment Evolution for Terminal Agents

The paper introduces "environment evolution," a method that incrementally raises the difficulty of interactive environments for terminal agents using off‑policy updates. It derives three evolution directions tied to a multi‑turn learning objective and implements them via a loop‑engineered multi‑agent harness. Experiments with models such as Hy4 preview, Claude Opus 5, GPT‑5.6 Sol, Qwen3.6‑27B, and Qwen3.6‑35B‑A3B demonstrate that this approach consistently generates harder environments and yields significant performance gains on Terminal‑Bench 2.1.