arXiv AI

Learning to Construct Practical Agentic Systems

arXiv:2606. 00189v1 Announce Type: cross Abstract: Automated design and optimization of agentic LLM-based systems leads to sophisticated systems that substantially improve result quality over off-the-shelf agentic patterns.

arXiv AI
Sep 10

Learning to Configure Agentic AI Systems

The paper introduces ARC, a lightweight hierarchical policy that learns to configure LLM‑based agent systems on a per‑query basis by treating each configuration as a temporally extended option in a semi‑Markov decision process. Unlike fixed templates or hand‑tuned heuristics, ARC dynamically selects workflows, tools, token budgets, and prompts tailored to the difficulty of each query. Experiments on reasoning, tool‑use, and agentic benchmarks show that ARC outperforms budget‑matched tool‑augmented LLMs, boosting reasoning accuracy by 31.3%, tool‑use accuracy by 13.95%, and doubling success on the τ‑Bench Airline Pass task from 9.0% to 18.0%.

By Aditya Taparia, Som Sagar, Ransalu Senanayake
arXiv AI
Jul 20

ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning

arXiv:2607. 15660v1 Announce Type: new Abstract: While LLM agents demonstrate strong reasoning abilities in compact and well-defined scenarios, they struggle to maintain robustness and effectiveness when faced with large-scale, diverse, and dynamic real-world environments that demand seamless tool integration.

By Shuaiyu Zhou, Fengpeng Yue, Zengjie Hu, Yuanzhe Shen, Chenyang Zhang, feng hong, Cao Liu, Ke Zeng
arXiv AI
Aug 24

AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale

AgentMercury is a scalable framework that synthesizes executable environments from high‑level business scenarios instead of task‑specific benchmarks. It creates a persistent world with entities, services, tools, and invariants, allowing diverse tasks and interaction trajectories to emerge naturally. The authors generated 4,783 environments across 14 industries and 50 countries, and training reinforcement‑learning agents on them improved performance on enterprise workflows and out‑of‑domain benchmarks, while the construction process itself can be learned to increase authoring success.

By Minbyul Jeong, Chanwoong Yoon
arXiv AI
2d ago

LLM-based Agentic Reasoning Frameworks: A Survey from Methods to Scenarios

The article surveys LLM-based agentic reasoning frameworks, presenting a unified formal language that categorizes them into single-agent, tool-based, and multi-agent methods. It reviews application scenarios in scientific discovery, healthcare, software engineering, society, economics, and general-purpose tasks, and compares the distinct features and evaluation strategies of each category. The survey highlights the rapid development of complex agentic systems in real-world contexts.

By Bingxi Zhao, Lin Geng Foo, Ping Hu, Christian Theobalt, Hossein Rahmani, Jun Liu
arXiv AI
Sep 25

Decoding ML Decision: An Agentic Reasoning Framework for Large-Scale Ranking System

The paper introduces GEARS, a framework that treats ranking optimization as an autonomous discovery process within a programmable experimentation environment. By encapsulating ranking expert knowledge into reusable agent skills, GEARS allows operators to steer systems through high-level intent personalization rather than static model selection. The framework also includes validation hooks to enforce statistical robustness and filter out brittle policies, and experimental results show that GEARS consistently finds near‑Pareto‑efficient policies while maintaining deployment stability.

By Longfei Yun, Yihan Wu, Haoran Liu, Xiaoxuan Liu, Ziyun Xu, Yi Wang, Yang Xia, Pengfei Wang, Mingze Gao, Yunxiang Wang, Changfan Chen, Wenjie Fu, Hong Yan, Junfeng Pan
arXiv AI
Aug 18

Agent Gym: A Framework for Continuous Evaluation and Evolution of LLM Agents Through Human-in-the-Loop Feedback

arXiv:2608. 15591v1 Announce Type: new Abstract: Large Language Model (LLM) agents deployed in production environments face a fundamental tension: the agent's behavior is frozen at deployment time, while the business rules and edge cases it must handle continue to evolve.

By Pouya Ghiasnezhad Omran, Michael Zimmermann, Duncan Cambridge, Ashmita Kapoor, Tanya Dixit