arXiv AI By Wei Liu, Min Gao, Yali Du, Yulan He

EnvLunch: The Environment as a Free Lunch for Learning to Interact

Read the original on arXiv AI →

EnvLunch proposes a warm‑up training stage that uses the executable environment itself as a source of verifiable tasks, eliminating the need for human‑written or model‑generated task descriptions. By sampling valid action trajectories, executing them, and training agents to recover equivalent trajectories from final observations, EnvLunch achieves over 9‑point performance gains on downstream tasks and reduces the required annotated examples by 8 to 32 times compared to baselines. This approach also improves fine‑tuning on benchmarks beyond data analysis, offering a more efficient starting point when annotated tasks are scarce.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Aug 7

EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning

arXiv:2608. 06197v1 Announce Type: new Abstract: Training large language model agents for long-horizon tool use typically relies on interactions with real or synthesized executable environments, whose construction and verification are costly, or on external simulators that are difficult to ground.

By Zishan Xu, Zhiyuan Yao, Yuxin Chen, Yifu Guo, Zhengxi Lu, Yuquan Lu, Jinyang Huang, Yan Xu, Yasheng Wang, Weinan Zhang, Xingshan Zeng, Weiwen Liu
arXiv AI
Sep 24

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.

By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen
arXiv AI
Sep 25

Breaking the Environment Wall: Evolving LLM Agent Environments for Recursive Self-Improvement

The paper introduces Env‑Rethink, a 27B post‑trained model system designed to help large language model agents better interact with complex, evolving environments. It builds Collection Maps and Event Logs to organize scattered information, uses offline trajectory learning to detect noise, and generates virtual event histories to evolve environments for more challenging tasks. Experiments show that Env‑Rethink improves downstream task performance by over 15.1% rubric pass rate across nine models on 30 tasks.

By Yukai Wu, Yuanjing Yang, Le Zhou, Shaokun Han, Haoyu Wang, Zirui Tang, Weihuang Zheng, Maxm Pan, Xuanhe Zhou, Fan Wu