arXiv AI By Ik-hwan Kim, Hyeongrok Han, Mingi Jung, Sangwon Yu, Jinseok Hong, Sang Hun Kim, Yoonyoung Choi, Sungroh Yoon

Distilling Metacognitive Behaviors through Agentic Editing

Read the original on arXiv AI →

The paper introduces Metacognitive Behavioral Tuning (MBT) and its agentic variant MBT‑A, which edit long reasoning traces from a teacher model to insert seven metacognitive behaviors—such as planning, thorough verification, and avoiding shortcuts—at appropriate points. By applying these edits line‑by‑line and recording each as a git commit, MBT‑A avoids summarization and distributes insertions throughout the trace. Experiments on competition math show that a Qwen3.5‑4B‑Base student trained on MBT‑A traces achieves higher scores (85.4 vs. 83.1) than standard supervised fine‑tuning, and the inserted behaviors transfer to other student models, increasing the frequency of rare behaviors.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 27

ReGE: Stronger Agents through Experience Synthesis

ReGE is a framework that transforms recorded interactive task experience into guidance for new attempts. Its implementation, ReGE‑Syn, synthesizes execution records and artifacts into concise, self‑contained instructions using a single coach call, without updating model parameters. Experiments on four benchmarks show that ReGE improves accuracy by roughly 9–10 percentage points for GPT and Claude, and significantly reduces guidance‑construction tokens while maintaining success rates.

By Jiarong Liang, Yubo Wang, Zijie Liu, Yuxuan Zhang, Ping Nie, Wenhu Chen
arXiv Machine Learning
Oct 12

State-OPD: State-Grounded On-Policy Distillation for Multi-Turn Agents

State-OPD introduces a state‑grounded on‑policy distillation framework that separates the objective task and action‑observation record from the student’s internal reasoning trajectory. By removing prior student reasoning and resampling complete reasoning‑action responses at high‑entropy states, the method improves teacher supervision and action diversity. Evaluations on ALFWorld, ScienceWorld, and WebShop show State‑OPD achieves the highest macro‑average success rates for Qwen3‑1.7B and Qwen3‑4B students, even surpassing a larger teacher model on certain tasks.

By Zhentao Zhang, Yanzhao Zheng, Yanlin Liu, Yuanqiang Yu, Tianze Xu, Chao Ma, Jihuai Zhu, Lelun Wu, Baohua Dong, Hangcheng Zhu, Ruohui Huang, Gang Yu
arXiv AI
Jun 6

Trace2Skill: Distill Trajectory-Local Lessons into Transferable Agent Skills

arXiv:2603. 25158v5 Announce Type: replace Abstract: Large Language Model (LLM) agents increasingly rely on domain-specific skills, yet manually authoring such skills does not scale, and skills generated purely from parametric knowledge often miss critical operational pitfalls.

By Jingwei Ni, Yihao Liu, Xinpeng Liu, Yutao Sun, Mengyu Zhou, Pengyu Cheng, Dexin Wang, Erchao Zhao, Xiaoxi Jiang, Guanjun Jiang
arXiv AI
Sep 24

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.

By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen