arXiv AI

TRACE: Transition-Aware Residual Control for Multi-Objective Materials Discovery

TRACE is a transition‑aware residual control framework designed to improve multi‑objective materials discovery with large language model agents. It records each local refinement as a parent‑edit‑child transition, aggregates evidence to estimate reusable edit effects, and ranks future edits by their predicted ability to reduce remaining constraint violations while protecting already satisfied objectives. In a controlled comparison, TRACE outperforms the state‑of‑the‑art LLEMA baseline, raising the macro‑average hit rate from 18.13% to 25.96%.

arXiv Computation and Language
Sep 14

Local Edits, Global Ripples: Replay-Informed Policy Adaptation for Workflow Synthesis

The paper introduces RIPPLE, a method for adapting workflow-synthesizing agents through prompt-policy editing without retraining the underlying model. RIPPLE diagnoses failed execution trajectories, maps failures to specific policy segments, and restricts edits to those segments. It then evaluates candidate edits in isolation and replays only those that remain safe after composition, achieving up to a 23.1% improvement in validation success on a synthetic benchmark and positive gains on additional language‑model backbones.

By Manqing Mao, Hong Wang, Samson Koelle, Jie Yuan, Zhuoer Wang, James Feng, Yanjun Lin, Daniel Edmiston, Nikki Lijing Kuang, Zhecheng Sheng, Wei Niu
arXiv AI
Sep 24

Agent-Editing World Model: Rethinking World Modeling for LLM Agents

The paper introduces the Agent-Editing World Model (AEWM), a new approach that models how reasoning and actions influence future task progress instead of simulating tool responses. AEWM includes an Action Judge that classifies decisions as Critical, Exploratory, or Noisy, and a State Revision mechanism that edits noisy reasoning–action continuations from the same observed history. The integrated system, EditAct, directly updates the underlying state during real execution, leading to significant performance gains across multiple benchmarks and agent backbones.

By Shuang Sun, Guoxin Chen, Fanzhe Meng, Jia Deng, Huatong Song, Jinhao Jiang, Wayne Xin Zhao, Hongteng Xu, Ji-Rong Wen
arXiv AI
Jul 1

Contrastive Reflection for Iterative Prompt Optimization

arXiv:2606. 30840v1 Announce Type: new Abstract: LLM agents are becoming central to information retrieval: they issue retrieval queries, synthesize answers, and increasingly serve as judges for IR evaluation.

By Derek Koh, Jinghui Mo, Benjamin H. Le, Jiening Zhan, Baofen Zheng, Kevin Bevis, Nathaniel C. Owen, Lauren Elizabeth Charney, Wenqiong Liu, Jingwei Wu
arXiv Machine Learning
Oct 19

Edit Discovery in Human-AI Interactions

arXiv:2610.22661v1 Announce Type: new Abstract: Human-AI interactions are becoming a rich source of data for improving AI systems: while many model responses are already satisfactory, others expose f...

By Alireza Mirrokni, Shayan Kiyani, George Pappas, Hamed Hassani
arXiv Computation and Language
5d ago

TraceSpec: Understanding and Improving Speculative Decoding for LLM Agents

TraceSpec is a framework that links trajectory evaluation with adaptive draft training to improve speculative decoding in large language model agents. It introduces a dynamic execution strategy combined with fixed‑prefix replay and provides a new corpus (TraceSpec‑Traj) of 10,000 training and 2,500 test states covering browsing and software engineering tasks. Experiments show that TraceSpec’s state‑conditioned draft allocation boosts replay throughput by 12.5%–22.6% and increases accepted length by up to 10.0% compared to fixed‑turn supervision.

By Jihao Zhao, Shuaishuai Zu, Pengfei Li, Biao Qin, Guanghuan Fang, Ben Feng, Baochuan Yang
arXiv AI
Oct 7

Learning from Revision Consequences: Hindsight Meta-Experience Distillation for Self-Improving Agents

The paper introduces Hindsight Meta-Experience Distillation (HMED), a method that lets self‑improving agents evaluate how revisions to their Meta‑Skills affect skill discovery by re‑executing both the original and revised Meta‑Skills from the same initial state. By comparing these outcomes, HMED creates structured Meta‑Experiences that provide learning signals even for revisions that are not ultimately kept. Experiments on three interactive benchmarks show that HMED consistently outperforms strong baselines, improving skill discovery by focusing on the consequences of the improvement process rather than just branch outcomes.

By Qianhan Feng, Zhongzhen Huang, Yakun Zhu, Xiaofan Zhang, Qi Dou