arXiv Computation and Language

Trajectory2Gym: Decision-Grounded Compositional Interaction Synthesis for Tool-Use Agents

arXiv AI
Sep 3

UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents

UniToolCall introduces a unified framework for tool-use in large language model agents, standardizing toolset construction, dataset generation, and evaluation. The framework aggregates over 22,000 tools and creates a hybrid training corpus of more than 390,000 instances by combining ten public datasets with synthetically generated, structurally controlled trajectories. It models diverse interaction patterns—single‑hop vs. multi‑hop, single‑turn vs. multi‑turn, serial vs. parallel execution—and adds an Anchor Linkage mechanism to enforce cross‑turn dependencies, while converting seven public benchmarks into a common Query–Action–Observation–Answer format for fine‑grained evaluation.

By Yijuan Liang, Xinghao Chen, Yifan Ge, Ziyi Wu, Hao Wu, Changyu Zeng, Wei Xing, Xiaoyu Shen
arXiv Computation and Language
Aug 31

ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL

ContextPilot is a proactive context‑management framework designed to improve long‑horizon agentic reasoning with large language models. It expands the toolset to include planning, long‑term memory, and soft context offloading, and introduces a reinforcement‑learning strategy that focuses on critical editing decisions and assigns action‑level advantages. Experiments on long‑context QA and deep search tasks demonstrate that ContextPilot achieves stronger performance with a more compact working context, outperforming existing baselines across various base models and benchmarks.

By Zhuoshi Pan, Qizhi Pei, Junru Lu, Honglin Lin, H. Vicky Zhao, Di Yin, Xing Sun
arXiv AI
Oct 28

PIVOT: Bridging Planning and Execution in LLM Agents via Trajectory Refinement

PIVOT (Plan-Inspect-eVOlve Trajectories) is a self‑supervised framework that refines large‑language‑model agent plans by treating trajectories as optimizable objects. It operates in four stages—PLAN, INSPECT, EVOLVE, and VERIFY—using structured losses and textual gradients to iteratively improve trajectories and ensure compliance with task constraints. Experiments on DeepPlanning and GAIA show that PIVOT achieves up to 94% relative improvement in constraint satisfaction with human‑in‑the‑loop feedback and still delivers significant gains autonomously, while using 3x to 5x fewer tokens than competing methods.

By Tuo Zhang, Alin-Ionut Popa, Yan Xu, Rui Song, Dimitrios Dimitriadis
arXiv AI
Aug 28

SWE-Prime: Fewer Trajectories, Better Performance

SWE-Prime introduces a two-stage supervised fine-tuning data selection process for large language models tackling software issues. The first stage filters entire trajectories by quality and representativeness, while the second stage selects meaningful semantic segments based on contribution, learnability, and risk. Experiments on SWE-Bench Pro and Verified demonstrate that training on just 10% of trajectories chosen by SWE-Prime surpasses full-dataset training, achieving up to 12.2% and 24.2% performance gains.

By Dewu Zheng, Ruizhe Ye, Yanlin Wang, Yang Ye, Hongyu Zhang, Ensheng Shi, Xilin Liu, Yuchi Ma, Jianxing Yu, Zibin Zheng
arXiv AI
Oct 15

CoEvoke: Evoking Multi-Agent Collaboration for Trajectory Collection

arXiv:2610.14021v1 Announce Type: cross Abstract: Training multi-agent collaboration requires trajectories of checking, feedback, and repair, yet task-solving rollouts may end in immediate approval o...

By Lin Wu, Shu Yao, Yuheng Wang, Jingru Fan, Huatao Li, Yihan Li, Liu Yixuan, Cheng Liu, Jian Chang, Zeyu Zhao, Aohua Zhang, Huiying Zhao, Shuyuan Zhu, Chen Qian
Hugging Face Trending Papers
Aug 27

SWE-Prime: Fewer Trajectories, Better Performance

SWE-Prime introduces a two‑stage, multi‑granularity supervised fine‑tuning (SFT) data selection process for large language models tackling real‑world software problems. The first stage filters entire trajectories based on process quality, result quality, and representativeness, while the second stage evaluates semantic segments for contribution, learnability, and risk, keeping all segments in context but only penalizing selected ones during training. Experiments on SWE‑Bench Pro and Verified demonstrate that training on just 10% of trajectories chosen by SWE‑Prime outperforms full‑dataset training, achieving up to 12.2% and 24.2% relative gains.

Hugging Face Trending Papers
Sep 3

Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments

Terminal-Universe is a framework that converts large collections of terminal-based agent trajectories into reusable, executable environments. By replaying recorded file operations and filling missing files with a completion agent, it reconstructs the original workspace and generates new tasks, scaling them in breadth (cross-workspace queries) and depth (multi-round interactions). The resulting 37.3k task-sufficient environments enable significant performance gains when fine‑tuning language models on terminal‑centric benchmarks.

arXiv AI
Oct 31

Where to Learn and How Far to Roll Out: Efficient Adaptive Training for GUI Agents

The paper proposes a two-stage adaptive training framework for GUI agents that addresses both where to learn and how far to roll out during training. It creates reusable intermediate checkpoints from expert trajectories and selects informative pivots using action disagreement to focus one-step reinforcement learning on uncertain decisions. The method then progressively expands policy responsibility through adaptive Local, Suffix, and Root training, enabling repeated training from intermediate states and reducing environment interaction by 56‑61% while improving task performance on MobileGym and CUA‑Gym‑Hub.

By Yuxiang Chai, Quyu Kong, Panrong Tong, Steven Hoi, Yue Wang