arXiv AI

Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents

The paper introduces component routing for self‑improving GUI agents, separating experience into locators, procedures, state facts, and lessons, and directing each to either the model weights or the prompt context. Experiments across three backbone families, two environments, and multiple seeds show that routing improves performance over whole‑trajectory baselines, with a rule based on recurrence and state‑conditionality accurately predicting the optimal destination. The study also analyzes how training dynamics and producer‑consumer differences affect the value of each destination, revealing that readout decreases for frequently recurring items when written to weights, while context gains grow with the information gap and weight gains shrink with the policy gap.

arXiv Computation and Language
Aug 27

AEL: Evolving Agent Harness in Open-Ended Environments

The paper introduces Agent Evolving Learning (AEL), a two‑timescale framework that dynamically evolves an LLM agent’s memory‑retrieval harness in open‑ended environments. A fast Thompson‑Sampling bandit selects among retrieval policies each episode, while a slower LLM reflection diagnoses performance drops and injects new policies when the current set plateaus. AEL outperforms ten self‑improving and non‑LLM baselines on a sequential portfolio benchmark, boosting Sharpe ratio by 27% and achieving significant accuracy gains on a support‑ticket routing stream.

By Wujiang Xu, Jiaojiao Han, Minghao Guo, Kai Mei, Xi Zhu, Han Zhang, Dimitris N. Metaxas
arXiv Machine Learning
Aug 12

MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale

arXiv:2608. 10333v1 Announce Type: new Abstract: LLM agents execute heterogeneous sequences of model calls within a single task: some invocations require careful reasoning, while others are structured steps such as formatting or tool-argument construction.

By Yuhang Yao, Zeyu Wang, Wanyi Chen, Tongyun Yang, Yuhang Han, Jie Xiao, Chengke Bao, Tianyi Zhao, Lynn Ai, Eric Yang, Tianyu Shi
arXiv Machine Learning
Jul 31

Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale

arXiv:2607. 28074v1 Announce Type: cross Abstract: Computer-use agents learn from what their actions change, so training one needs applications it can act on, break and reset.

By Yash Pandya, Sahil Gupta, Sarthak Harne, Archana Yadav, Kavyansh Chourasia, Hussein Mozannar, Vibhav Vineet, Sara Abdali, Corby Rosset, Yash Lara, Ahmed Awadallah, Ece Kamar, Akshay Nambi
arXiv AI
Aug 25

TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents

TRACE (TRAjectory-Contrastive Evolution) is a self‑evolving skill bank that improves the consistency and limit‑awareness of large‑language‑model agents without changing the model weights. By iteratively refining modular skills based on successful and failed trajectories, TRACE raises consistent performance (Pass^3) on the CAR‑bench in‑car assistant tasks from 59.9 % to 94.5 % on GPT‑5.5 and achieves first place on the hidden set with GPT‑5.6‑Sol. The approach demonstrates that a skill‑based, self‑evolution loop can convert a model’s potential into stable, reliable behavior.

By Wenhao Wu, Menghao Zhang, Xin Wang, Zhi Wang, Kun Shao, Jian Luan