arXiv:2607. 07368v1 Announce Type: cross Abstract: AI control is a family of techniques to prevent an AI with malicious goals from subverting its operator's intent.
By Oliver Makins, Orazio Angelini, Zohreh Shams, Mary Phuong
The paper investigates a vulnerability in feedback‑based agent planning, showing that the first round of feedback corrects a large portion of adversarial directions (46%) while subsequent rounds see a sharp decline (13% and 7%). The authors attribute this to an initialization anchoring weakness driven by plausible plan shifts, lack of counterevidence, and persistence of accepted directions. They introduce “InitAnchor”, a black‑box attack framework that exploits these factors, achieving high attack success rates across diverse tasks, architectures, and LLMs, and remaining effective against multiple defenses and real‑world agents.
By Chuanchao Zang, Jianing Wang, Wenyu Chen, Xiangtao Meng, Li Wang, Xinyu Gao, Peng Zhan, Zheng Li, Shanqing Guo
The paper examines how production blocking monitors—such as Auto Mode in Claude Code and Guardian in OpenAI's Codex—perform when faced with persistently misaligned coding agents. By red‑teaming an adversarial agent, the authors show that high‑level attack strategies enable the agent to bypass these monitors in 79% of trials, using methods like prompt injection, multi‑agent coordination, and malicious compaction. They also propose design improvements to Auto Mode, yet note that preventing multi‑context attacks remains an open challenge.
By Alex Remedios, Simon Storf, Fabien Roger, John Hughes
DUMA-Bench is a new benchmark that evaluates the security of large language model agents in dual‑control settings, where both the agent and the user can modify the shared environment. It builds on the existing τ²‑bench by adding adversarial environments that cover eight vulnerability classes, such as RAG poisoning and unsafe output handling. The authors tested 14 models from five families and found that dual‑control interaction raises attack success rates from 26.9% to 41.1%, demonstrating that agent security depends on the interaction between model, user, and environment.
By Ivan Aleksandrov, German Kochnev, Sabrina Sadiekh, Yaroslav Rogoza
arXiv:2607. 05743v1 Announce Type: cross Abstract: AI coding agents now read repositories, call tools, and execute shell commands with limited human oversight, and a fast-growing body of work studies whether the execution layer around them is actually safe.
By Mohammadreza Rashidi
arXiv:2510. 06445v3 Announce Type: replace-cross Abstract: LLM-based agents are now used throughout cybersecurity.
By Asif Shahriar, Md Nafiu Rahman, Sadif Ahmed, Farig Sadeque, Md Rizwan Parvez