arXiv AI

Co-Sight Harness: Externalized Control Assets and Deterministic Enforcement for Long-Horizon Business Agents

arXiv AI
Oct 2

ESCROW: Guarded and Dual-Objective Continual Maintenance for Agents in Policy-Governed Enterprise Workflows

ESCROW is a post‑deployment maintenance framework for large‑language‑model agents that operate under policy‑bound enterprise workflows. It ensures that any skill revisions proposed by the LLM are only deployed after empirical evaluation, using distributed diagnosis, consensus, per‑category non‑regression guards, cross‑cycle anti‑regression checks, and an accuracy–cost Pareto search to produce a versioned, auditable diff for each change. In a real production financial document‑auditing system, ESCROW achieved the best accuracy–cost trade‑off compared with baseline methods and demonstrated transferability on a public $ au$‑bench.

By Ruoqi Shu, Chen Dan, Xuhui Wang, Tianhua Xu, Mengxi Luo, Yanming Mai, Bo Wan
arXiv AI
Oct 15

SkillHorizon: Constructing Long-Horizon Agent Tasks through Skill Composition

arXiv:2610.14966v1 Announce Type: new Abstract: Long-horizon agents must complete workflows in which later activities depend on earlier outputs and changes to shared state. A key challenge for evalua...

By Yuxuan Liu, Zhaochen Su, Hangyu Guo, Shijue Huang, Zhixiong Zhang, Kawai Chung, Zhongwei Xie, Tianshi Zheng, Wei Fan, Qing Zong, Haochen Shi, Baixuan Xu, Haoran Li, Yangqiu Song
arXiv AI
Sep 15

When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundary

The paper investigates how AI agents that run long workflows using external tools can experience inconsistencies when retries, speculative execution, concurrency, or partial failures occur. It introduces an effect‑history model that distinguishes between actual external events and the agent’s observations, and catalogs eight common external‑effect anomalies. The authors analyze the standard Model Context Protocol tool interface, finding that its annotations are too coarse to fully express the necessary capabilities to prevent these anomalies, thereby motivating the need for reusable transactional contracts at the agent‑tool boundary.

By Artem Trofimov, Boris Novikov
arXiv AI
Sep 28

Beyond Approved Actions: Runtime Validation of Persistent Outcomes in Agent Workflows

EffectMatch is a runtime system that monitors and validates persistent changes made by large language model agents during software interactions. It collects all side‑effects within a controlled execution boundary and compares them against the application’s approved state, deciding whether to commit the changes and allow subsequent steps. In tests on 206 public business tasks, EffectMatch preserved correct executions and prevented all incorrect commits, with ablation studies showing the importance of each component.

By Haoran Zhang, Hengtong Zhang, Zhiyu Liang, Yu Yan, Decheng Zuo, Hongzhi Wang
arXiv Computation and Language
Aug 21

One Success Isn't Reliability: Thinkingbox, a Sandbox and Benchmark for Agents in Stateful Business Workflows

arXiv:2608. 19741v1 Announce Type: new Abstract: Recent agent benchmarks increasingly ground evaluation in executable environments, from code repair to web navigation, app APIs, and function calling.

By Zhuochun Li, Youngmin Ko, Ali Keramati, Nicola Ferri, Susana Palmaz Lopez Pelaez, Liang-Chun Tsai, Calvin Wang, Mirco Milletari, Tuhin Kundu, Vadim Smolyakov, Kjartan Olafsson, Tommy Guy
arXiv AI
Oct 16

Auditing Escalation Reliability in Healthcare LLM Agents: A Perturbation-Controlled Benchmark of Workflow-State Failures

The paper introduces a benchmark of 400 synthetic healthcare workflow episodes to evaluate large language model (LLM) agents’ reliability in escalating care when evidence is missing or conflicting. It finds that while clean decision accuracy is high (0.97), models miss a large proportion of necessary escalations (32–97%) under uncertainty, and even the largest 9.7B model’s performance drops to 0.78 in conflict scenarios. A workflow-aware controller improves utility and reduces missed escalations, but its effectiveness is limited by lexical generalization failures.

By Zihao Zheng (Washington University in St. Louis), Junyi Yao (Washington University in St. Louis), Baichuan Li (Southern Methodist University), Jiayu Long (Washington University in St. Louis)
arXiv AI
Oct 9

Safe, Persistent, and Evolving Agent Harness for Understanding Partially Observable Worlds

The paper introduces E‑Ledger, a multi‑agent harness that ensures safe and persistent execution of large language model agents in partially observable environments. It adds a code approval layer to enforce policy compliance and maintains a world ledger of verified hidden rules and dynamic state. To discover unknown rules, the authors propose WorldAbduct, an abductive framework that diagnoses execution trajectories, hypothesizes latent rules, and validates them before integrating them into the ledger, improving safe task completion on enterprise and scientific benchmarks.

By Yisen Gao, Yue Guo, Qing Zong, Yiwen Guo, Yangqiu Song