Lean4AgenticRL is a new framework that introduces multi‑level process rewards grounded in the Lean4 formalization schema to improve agentic reinforcement learning for large language models. It constructs a problem‑specific workflow system that balances capability and controllability, enabling verification of agent behavior and providing rewards at low‑, mid‑, and high‑levels. Experiments show that models trained with Lean4AgenticRL, such as LAR‑27B, outperform comparable models, achieving 77.3% on TerminalBench‑2.1 and surpassing the base model by an average of 9.89%.
By Ruida Wang, Gerald Friedland, Tong Zhang, Chris Kong
arXiv:2607. 22642v1 Announce Type: new Abstract: Enterprise coding agents translate natural-language analytical requests into executable code over proprietary APIs, schemas, and metric definitions.
By Aakash Kolekar, Sahika Genc, Shahriar Shariat, Bunyamin Sisman, Tibor Mezi, Barbara Poblete, Shree Vandana Kachroo, Calvin Chi, Parth Parmar, Ari Singer, Prayaas Jain, Cindy Barker, Benoit Dumoulin
arXiv:2602. 11351v2 Announce Type: replace Abstract: Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric applications.
By Yihang Yao, Zhepeng Cen, Haohong Lin, Shiqi Liu, Zuxin Liu, Jiacheng Zhu, Zhang-Wei Hong, Laixi Shi, Ding Zhao
AgentMercury is a scalable framework that synthesizes executable environments from high‑level business scenarios instead of task‑specific benchmarks. It creates a persistent world with entities, services, tools, and invariants, allowing diverse tasks and interaction trajectories to emerge naturally. The authors generated 4,783 environments across 14 industries and 50 countries, and training reinforcement‑learning agents on them improved performance on enterprise workflows and out‑of‑domain benchmarks, while the construction process itself can be learned to increase authoring success.
By Minbyul Jeong, Chanwoong Yoon
arXiv:2609.33665v2 Announce Type: replace
Abstract: Automatically generated environments provide a scalable source of interaction data for training general agents. However, existing approaches mainly...
By Xiao-Wen Yang, Weiyi Xu, Wen Da, Hang Xu, Canwei Li, Hong-Jie You, Pusen Dong, Yucheng Zeng, Zhaokai Luo, Yu-Feng Li, Yao Hu, Mu Chuan
The paper "It Takes Workflows to Evolve Better Workflows" introduces FloWright, a method that uses a hierarchical, structure‑aware reward system to allow one or more roles in a multi‑agent workflow to self‑evolve without extra models or data. It also proposes DataWright, an adaptive data hardening technique that transforms existing datasets into more challenging workflow‑level tasks. Experiments on document, slide, chart, code, math, and finance tasks show that small open models trained with FloWright can improve performance by up to +7.41%, with co‑evolving multiple roles yielding the largest gains.
"whyItMatters":"The work demonstrates that optimizing beyond the workflow generator—by enabling multiple agents to co‑evolve—can substantially enhance the effectiveness of multi‑agent workflows for complex real‑world tasks."
By Xuehang Guo, Haoyu Wang, Haifeng Chen, Yangyi Chen, Zhenhailong Wang, Qingyun Wang
arXiv:2606. 09138v1 Announce Type: new Abstract: Agentic reinforcement learning (RL) has become an important post-training paradigm for turning LLMs from static chatbots into interactive agents, giving rise to representative applications such as OpenClaw.
By Daoyu Wang, Mingyue Cheng, Qingchuan Li, Shuo Yu, Jie Ouyang, Qi Liu
CRM‑Agent‑Bench is a benchmark that evaluates language agents in customer‑relationship‑management settings by testing 555 stateful, multi‑turn tasks across nine business domains. Each task includes an executable contract with checks on actions, arguments, order, responses, target state, and protected state, and success requires meeting all these checks. The benchmark reports coverage, latency, and cost, showing that evaluated systems achieve 64.32%–83.60% strict success while varying in cost and domain reliability.
By Monojit Banerjee, Zhujun Lan, Defu Cao
arXiv:2608. 10538v1 Announce Type: new Abstract: Agent skills represent a standardized format for packaging procedural knowledge and domain expertise, serving within agent harness systems as an essential mechanism to continually constrain a language model's behavior space for repeatable, high-quality task execution.
By Chenhao Dang, Siyuan Xiong, Conghui He, Weijia Li
The paper introduces HiMA-Ecom, a hierarchical multi‑agent e‑commerce benchmark with 22.8K instances, where 17.7K include memory entries. It explores training, evaluation, and management of accumulated context in long‑horizon agentic systems, and proposes HiMA‑R1, a policy optimization method that controls trajectory context budgets and uses reward‑driven memory to accelerate convergence. Experiments show that agents built on 3B and 7B open‑source models outperform DeepSeek‑V3 by an average of 6.0 points, while reward‑driven memory cuts convergence steps by about 55%.
By Junxing Hu, Ai Han, Haolan Zhan, Pu Wei, Zhiqian Zhang, Yuhang Guo, Jiawei Lu, Zhen Chen, Haoran Li, Zicheng Zhang, Ling Li
arXiv:2607. 02975v1 Announce Type: new Abstract: Effective agency in social environments depends on when an agent seeks knowledge, when it acts, and whether its actions are justified by acquired information.
By Dan C. Hsu, Luke Lu
Agent skills represent a standardized format for packaging procedural knowledge and domain expertise, serving within agent harness systems as an essential mechanism to continually constrain a language model's behavior space for repeatable, high-quality task execution. However, because strong closed-source models entail high inference costs, current popular agent harnesses, such as Codex and OpenClaw, remain prohibitively expensive when deploying these skills to accomplish real-world tasks.