arXiv AI
Sep 15

When Tool Calls Succeed but Workflows Fail: Anomalies at the Agent-Tool Boundary

The paper investigates how AI agents that run long workflows using external tools can experience inconsistencies when retries, speculative execution, concurrency, or partial failures occur. It introduces an effect‑history model that distinguishes between actual external events and the agent’s observations, and catalogs eight common external‑effect anomalies. The authors analyze the standard Model Context Protocol tool interface, finding that its annotations are too coarse to fully express the necessary capabilities to prevent these anomalies, thereby motivating the need for reusable transactional contracts at the agent‑tool boundary.

By Artem Trofimov, Boris Novikov
arXiv AI
3d ago

Silent Failures in Agent-Tool Interaction: An Audit of ToolUniverse

The paper audits silent failures in agent-to-tool interactions within the ToolUniverse environment, focusing on 15 scientific tools. It identifies 91 failures—primarily missing data or inconsistent search/filtering—occurring mainly in the API and wrapper layers, and shows how these silent failures can propagate downstream into seemingly valid outputs. The authors propose contextual reliability and recommend testing, disclosure, monitoring, and measurement strategies for the agent-tool pipeline.

By Shreya Gopalan, Devansh Singh, Sundaraparipurnan Narayanan