REDAgentBench: Executable Red Teaming and Faithful Measurement of LLM Agent Systems
arXiv:2608. 10669v1 Announce Type: new Abstract: Large language model (LLM) agents combine language-based reasoning with external tools to perform complex tasks.
CART (Closed‑Loop Adaptive Red Teaming) is a framework that iteratively uses results from red‑teaming tests to guide subsequent probes, thereby expanding risk coverage and maintaining diversity. It separates the roles of Challenger (test generator), Target (model or agent under test), and Judge (result evaluator), enabling independent study of each component. Across multiple evaluation families, CART uncovers more failures and higher risk than static prompt replay, demonstrating that adaptive, continuous testing reveals weaknesses that fixed‑prompt methods miss.
arXiv:2608. 10669v1 Announce Type: new Abstract: Large language model (LLM) agents combine language-based reasoning with external tools to perform complex tasks.
The paper presents a three‑phase comparative study of three evaluation frameworks—trace‑based LLM judging, text‑only LLM judging with red‑teaming, and deterministic heuristics—applied to two analytics agents. Phase 1 shows high stability (97% of configurations) across agents, Phase 2 finds the trace‑based framework delivers the best precision‑recall (F1 = 0.90) while text‑only generates many false alarms, and Phase 3 uncovers 24 novel failures not found by functional testing or security red‑teaming. The authors conclude that the type of information used by the harness dictates evaluation quality, functional and security tests are complementary, and LLM‑based harnesses detect subtle errors missed by humans, recommending a dual‑framework approach.
arXiv:2606. 24589v1 Announce Type: new Abstract: Scaling adversarial evaluation of large language models requires both a method for generating hard inputs and a reliable way to confirm that resulting failures are real.
Production LLM agents such as Claude Code and Codex operate over untrusted content, files, commands, and workspace state, making safety failures directly actionable. Red-teaming must therefore keep pace with evolving models and tools.
arXiv:2602. 16346v4 Announce Type: replace-cross Abstract: LLM-based agents execute real-world workflows via tools and memory.
TestJack is a scalable framework that audits large language model (LLM) coding agents by generating new tests for each trial, focusing on prompt requirements that may be violated. It keeps only the tests passed by the ground‑truth patch and re‑examines failures, providing replayable evidence for each confirmed error. In experiments across six model backends and five benchmarks, TestJack found that 34.4% of trials deemed correct actually violated task requirements, reducing the overall resolution rate from 50.6% to 33.2%.
Automatic red teaming increasingly relies on large language models (LLMs) to iteratively diagnose failed attacks and propose improved adversarial prompts or injections. Although prior work strengthens...
arXiv:2607. 16345v1 Announce Type: cross Abstract: Modern agentic systems increasingly rely on skills: installable packages of natural language and code that teach an LLM agent to perform a domain task.
Large language model (LLM) agents are increasingly evaluated on their ability to use tools, plan multi-step tasks, coordinate with other agents, and operate over extended horizons. Reported benchmark gains often obscure recurring failure modes documented across otherwise unrelated evaluation efforts.
The paper introduces ARTIS, a framework that separates exploration from commitment by using iterative simulation to test large language model actions before real-world execution. This approach extends inference-time computation to boost action-level reliability and robustness while avoiding environmental risk. The authors also highlight that standard LLM simulators miss rare, high-impact failures, and propose a risk‑aware simulator that focuses on fidelity for failure‑inducing actions, showing significant reliability gains across agentic benchmarks.
arXiv:2607. 11698v1 Announce Type: cross Abstract: Production LLM agents such as Claude Code and Codex operate over untrusted content, files, commands, and workspace state, making safety failures directly actionable.
arXiv:2608.00677v2 Announce Type: replace Abstract: AI agents operate in persistent environments where early state changes can influence decisions far into the future. Unlike conventional language-mo...