arXiv AI By Sachin Gupta

AgentTrustCI: Build-Time Policy, Grounding, and Trajectory Tests for Java LLM Agents

Read the original on arXiv AI →

AgentTrustCI is a Java/JUnit 5 framework that turns application‑layer expectations—such as tool selection, grounding of answers, and adherence to workflows—into policy, grounding, and trajectory checks over recorded traces. It provides deterministic replay for repeatable build‑time tests and a judge interface for optional semantic evaluation. In tests across 55 synthetic cases from seven enterprise domains, the full pipeline correctly classified all injected faults and passing controls, while single‑layer configurations handled 35 cases, demonstrating the framework’s coverage and repeatability.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

arXiv AI
Jul 1

An Executable Benchmarking Suite for Tool-Using Agents

arXiv:2605. 11030v2 Announce Type: replace-cross Abstract: Closed-loop tool-using agents are increasingly evaluated in executable web, code, and micro-task environments, but benchmark reports often conflate workloads, action-generating drivers, and the evidence admitted for systems-facing claims.

By Zhiqing Zhong, Zhijing Ye, Jiamin Wang, Xiaodong Yu