arXiv Computation and Language By Yuechen Luo, Zhiyi Lai, Miao Ziqi, Zihang Xu, Jingxuan Xu, Songwei Yu, Wenqiang Zhu, Weihao Li, Junhao Fan, Haoyang Huang, Yanan Wu, Ken Deng

OPRD: On-Policy Reminder Distillation for Long-Horizon Coding Agents

Read the original on arXiv Computation and Language →

The paper introduces On-Policy Reminder Distillation (OPRD), a method that enhances long-horizon coding agents by combining multi-scope reminder supervision with outcome-based routing. OPRD uses successful rollouts as autoregressive self-imitation targets and failed rollouts for reminder-conditioned reverse-KL supervision from a teacher that re-evaluates student prefixes. The approach improves task resolution rates by 11.3 points and cuts error events by 50.2% on several SWE-bench benchmarks.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv Computation and Language
2d ago

Beyond Self-Reflection: An Execute-Distill-Verify Framework for Agentic Experience Learning

The paper introduces EDV, an Execute‑Distill‑Verify framework that constructs offline experience for large language model agents without updating model parameters. In EDV, multiple heterogeneous agents execute tasks, a distiller extracts candidate lessons from their trajectories and feedback, and executors review these lessons, keeping only those unanimously approved. Experiments on τ²‑bench, Mind2Web, and MMTB demonstrate improved performance on revisited tasks and within‑domain transfer, while a Retail subset evaluation shows EDV cuts the Self‑Confirmation Trap Rate from 11.0% to 5.0%.

By Shiding Zhu, Yudi Qi, Yajie Wang, Jiaze Li, Chao Song, Yaorui Shi, Yibo Miao, Hanqi Gao, Kai Zhang
arXiv AI
Sep 21

DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinement

arXiv:2609.21423v1 Announce Type: new Abstract: Online agent deployments produce abundant execution traces, while task-specific verification and expert annotation are costly to scale. We study how to...

By Siyuan Liu (Fudan University, Meituan Longcat Team), Fan Yu (Fudan University, Meituan Longcat Team), Dongyu Ru (Meituan Longcat Team), Yizhu Liu (Meituan Longcat Team), Yifan Yang (Meituan Longcat Team), Xuezhi Cao (Meituan Longcat Team), Xunliang Cai (Meituan Longcat Team), Yixin Cao (Fudan University)
arXiv Computation and Language
4d ago

TraceSpec: Understanding and Improving Speculative Decoding for LLM Agents

TraceSpec is a framework that links trajectory evaluation with adaptive draft training to improve speculative decoding in large language model agents. It introduces a dynamic execution strategy combined with fixed‑prefix replay and provides a new corpus (TraceSpec‑Traj) of 10,000 training and 2,500 test states covering browsing and software engineering tasks. Experiments show that TraceSpec’s state‑conditioned draft allocation boosts replay throughput by 12.5%–22.6% and increases accepted length by up to 10.0% compared to fixed‑turn supervision.

By Jihao Zhao, Shuaishuai Zu, Pengfei Li, Biao Qin, Guanghuan Fang, Ben Feng, Baochuan Yang