arXiv AI

CART: Closed-Loop Adaptive Red Teaming for Large Language Models

CART (Closed‑Loop Adaptive Red Teaming) is a framework that iteratively uses results from red‑teaming tests to guide subsequent probes, thereby expanding risk coverage and maintaining diversity. It separates the roles of Challenger (test generator), Target (model or agent under test), and Judge (result evaluator), enabling independent study of each component. Across multiple evaluation families, CART uncovers more failures and higher risk than static prompt replay, demonstrating that adaptive, continuous testing reveals weaknesses that fixed‑prompt methods miss.

arXiv AI
5d ago

Comparative Analysis of Agent Evaluation Frameworks: Stability, Detection, and Discovery in Enterprise Analytics Agents

The paper presents a three‑phase comparative study of three evaluation frameworks—trace‑based LLM judging, text‑only LLM judging with red‑teaming, and deterministic heuristics—applied to two analytics agents. Phase 1 shows high stability (97% of configurations) across agents, Phase 2 finds the trace‑based framework delivers the best precision‑recall (F1 = 0.90) while text‑only generates many false alarms, and Phase 3 uncovers 24 novel failures not found by functional testing or security red‑teaming. The authors conclude that the type of information used by the harness dictates evaluation quality, functional and security tests are complementary, and LLM‑based harnesses detect subtle errors missed by humans, recommending a dual‑framework approach.

By Howard Zhang, Chuck Arvin, Logan Brown, Mihir Bhatia, Neelu Choudhary, Lily Miao
arXiv AI
Oct 9

TestJack: Should you trust the results in coding benchmarks? Agentic Coding Benchmarks Auditing via Evaluator Evolution

TestJack is a scalable framework that audits large language model (LLM) coding agents by generating new tests for each trial, focusing on prompt requirements that may be violated. It keeps only the tests passed by the ground‑truth patch and re‑examines failures, providing replayable evidence for each confirmed error. In experiments across six model backends and five benchmarks, TestJack found that 34.4% of trials deemed correct actually violated task requirements, reducing the overall resolution rate from 50.6% to 33.2%.

By Shuangjie Yao, Hao Wang, Koushik Sen, Simin Chen, Baishakhi Ray, Dawn Song
arXiv Computation and Language
Oct 12

ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulation

The paper introduces ARTIS, a framework that separates exploration from commitment by using iterative simulation to test large language model actions before real-world execution. This approach extends inference-time computation to boost action-level reliability and robustness while avoiding environmental risk. The authors also highlight that standard LLM simulators miss rare, high-impact failures, and propose a risk‑aware simulator that focuses on fidelity for failure‑inducing actions, showing significant reliability gains across agentic benchmarks.

By Xingshan Zeng, Lingzhi Wang, Weiwen Liu, Liangyou Li, Yasheng Wang, Lifeng Shang, Xin Jiang, Qun Liu