arXiv AI By Genliang Zhu, Xiaobo Chen, Ziyuan Wang, Chu Wang

Evidence-Guided Recovery for AI Agents with Ambiguous Tool Outcomes and Partial Execution

Read the original on arXiv AI →

The paper introduces an evidence‑guided recovery framework for AI agents that encounter ambiguous tool outcomes and partial execution, such as timeouts or failures. It defines a shared admissibility check for key expiry, authorization timing, dependencies, and residual effects, and a terminal certificate to distinguish actual goal satisfaction from publicly supported safe completion. In a finite study of 37 assignments, the approach achieved 28 certified completions, and in a larger comparison of 58 paired units, evidence‑guided advice certified 30 completions versus 9 for evidence prompting, demonstrating a significant improvement in task completion rates.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Oct 1

NAQD Env: A benchmark for selective withdrawal in language agents

The paper introduces NAQD‑Env, a synthetic benchmark designed to test language agents’ ability to selectively withdraw and resume actions when new evidence, permissions, or stop instructions arise. It evaluates models against a deterministic reference policy across eleven dependency families, measuring policy agreement, task value, withdrawal, resumption, and event reporting. Experiments on 350 scenarios show low withdrawal recall, no valid resumption, and limited policy alignment, highlighting the need to treat selective withdrawal as a distinct reliability component.

By Mohamed Abouzahra
arXiv AI
Oct 15

CoEvoke: Evoking Multi-Agent Collaboration for Trajectory Collection

arXiv:2610.14021v1 Announce Type: cross Abstract: Training multi-agent collaboration requires trajectories of checking, feedback, and repair, yet task-solving rollouts may end in immediate approval o...

By Lin Wu, Shu Yao, Yuheng Wang, Jingru Fan, Huatao Li, Yihan Li, Liu Yixuan, Cheng Liu, Jian Chang, Zeyu Zhao, Aohua Zhang, Huiying Zhao, Shuyuan Zhu, Chen Qian
arXiv AI
Sep 21

DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinement

arXiv:2609.21423v1 Announce Type: new Abstract: Online agent deployments produce abundant execution traces, while task-specific verification and expert annotation are costly to scale. We study how to...

By Siyuan Liu (Fudan University, Meituan Longcat Team), Fan Yu (Fudan University, Meituan Longcat Team), Dongyu Ru (Meituan Longcat Team), Yizhu Liu (Meituan Longcat Team), Yifan Yang (Meituan Longcat Team), Xuezhi Cao (Meituan Longcat Team), Xunliang Cai (Meituan Longcat Team), Yixin Cao (Fudan University)
arXiv AI
Oct 16

Confidence-Calibrated Inference Expansion for Evaluator-Guided Test-Time Reasoning

The paper introduces a compute‑aware three‑action controller for evaluator‑guided reasoning, deciding whether to trust the current answer, fallback, or expand inference. It scores terminal actions by predicted success and uses a rollout‑based surrogate for expansion, explicitly pricing compute cost. Experiments on width expansion and revision tasks show the controller improves utility over fixed policies while reducing online compute by about 30% and 16%, respectively, and demonstrates that evaluator‑guided reasoning is best viewed as resource allocation under uncertainty.

By Weida Liang, Kenji Kawaguchi
arXiv AI
Oct 21

Runtime Control for AI Agents: Closing the Evaluation--Execution Gap in Operational Workflows

The paper introduces a runtime assurance layer for language‑model agents operating in operational workflows, addressing the evaluation–execution gap where approvals may become invalid after changes in facts, evidence, policy, or authority. The proposed state‑bound configuration separates probabilistic measurement from deterministic adjudication, binds execution allowances to the basis of an approval, invalidates them upon logged changes, and rechecks admissibility at dispatch. In a scripted 42‑case replay, the approach identified 15 later‑invalidated approvals that a non‑re‑evaluating comparator missed, holding 14 affected actions before dispatch and compensating one landed effect.

By Jayesh Bhadane, Ramachandra Yerramsetti, Rajesh Gupta, Sumit Kumar