arXiv AI

SKILL.state: Scalable Long-Horizon Agent Skills

SKILL.state is a new runtime architecture for large language model agents that replaces the traditional append‑only conversational history with an explicit, mutable execution state. At each step the model receives only the immutable skill specification, the current structured state, and the latest observation, discarding intermediate reasoning after validating state updates. Experiments across datasets, models, and environments show that SKILL.state improves task accuracy and significantly reduces cumulative token consumption, proving that explicit execution state is a scalable, architecture‑agnostic abstraction for long‑horizon agent skills.

arXiv AI
Oct 7

AMBER: Training Long-Horizon Web Agents through Append-Only Memory

The paper introduces AMBER, an append‑only memory framework for language‑model agents that interact over long horizons. AMBER lets agents jointly learn to reason, act, and write free‑form memory, guaranteeing retention by construction and enabling end‑to‑end reinforcement learning without extensive curated data. Experiments on WebArena Lite show AMBER outperforms overwrite‑based memory by 4.09 percentage points in average success and improves task completion rates in repeated runs.

By Chinmay Savadikar, Zhaoyu Zhang, Mingyu Zhao, Shuang Xie, Han Li, Tianfu Wu, Lingyun Wang
arXiv AI
Sep 2

Learning What to Retain: Gated-Memory Routing for Efficient Collaboration in Multi-Agent LLM Systems

The paper introduces Gated-Memory Routing, a method for efficient collaboration in multi‑agent large language model systems. It uses a learned execution memory with write and retrieval gates to keep only non‑redundant reasoning steps, and an adaptive halting controller to stop execution when enough evidence is gathered. Experiments on five reasoning and code‑generation benchmarks show the approach achieves higher accuracy and reduces inference cost by 31.9% compared to the strongest baseline.

By Rakibul Hasan Rajib, Mengxing Zheng, Qian Lou
arXiv AI
Jun 15

From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI

arXiv:2606. 14502v1 Announce Type: new Abstract: Large Language Models (LLMs) are undergoing a fundamental transformation from conversational generators into integrated AI systems capable of reasoning, action, memory, and self-improvement.

By Yongheng Zhang, Ziang Liu, Jiaxuan Zhu, Shuai Wang, Xiangqi Chen, Haojing Huang, Jiayi Kuang, Siyu Chen, Ao Shen, Hao Wu, Qiufeng Wang, Qian-Wen Zhang, Junnan Dong, Wenhao Jiang, Ying Shen, Hai-Tao Zheng, Yinghui Li, Di Yin, Xing Sun, Philip S. Yu
arXiv AI
Oct 21

SPEM: Structure-Aware Procedural Memory for Efficient Skill Use in LLM Agents

SPEM is a lightweight, structure‑aware procedural memory framework designed to improve skill use in large language model agents. It stores individual skills in an Atomic Skill Memory and reusable skill compositions in a Skill‑DAG Memory, reusing high‑confidence templates when possible and falling back to atomic skills with a Skill‑GNN for state‑aware selection. The system writes successful executions back as new Skill‑DAGs, enabling continuous accumulation of procedural knowledge and achieving higher effectiveness‑efficiency trade‑offs on ALFWorld and SkillsBench benchmarks.

By Ran Zhou, Zehui Kong, Fanyu Lin, Jiaheng Liu, Zhen Zhang, Yuxiang Ren
arXiv AI
3d ago

Compile Away Uncertainty: Self-Evolving Agent Skills via Programmatic Compilation

The paper introduces SkillCompiler, a framework that compiles self‑evolving agent skills into deterministic programs to reduce uncertainty from LLM reasoning. It decomposes skills into fine‑grained operations, selectively compiles well‑specified parts into validated programs, and reuses these programs across evolving skills. Experiments on five benchmarks and six model families show SkillCompiler outperforms state‑of‑the‑art methods, achieving up to a 32.33% improvement in task performance.

By Chengyu Yang, Yunxiang Zheng, Zongzheng Li, Jiamei Li, Boxun Lan, Xiaoyu Liu, Xiaoyu Zhang, Xiaohong Chen, Ming Hu
arXiv AI
Sep 25

HEXIS: Compiling Skills into Extended Finite State Machines

HEXIS is a system that compiles agent skills into extended finite state machines, separating skill knowledge from control flow. It uses local instructions within states to guide reasoning and generation, while explicit transition conditions manage execution progress. The incremental compiler maps skill clauses and tool interfaces to state operations, aligns development traces to identify missing operations, and updates are validated through static checks and replay of traces, resulting in improved success rates and reduced execution tokens across benchmarks.

By Minghao LI
arXiv AI
Sep 24

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.

By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen