arXiv:2510. 01359v2 Announce Type: replace-cross Abstract: Code-capable large language model (LLM) agents are embedded in software engineering workflows where they can read, write, and execute code, raising "jailbreak" stakes beyond text-only settings.
By Shoumik Saha, Jifan Chen, Sam Mayers, Sanjay Krishna Gouda, Zijian Wang, Varun Kumar
arXiv:2607. 00481v1 Announce Type: cross Abstract: Jailbreak attacks remain a critical threat to the safe deployment of large language models (LLMs).
By Junlong Liu, Haobo Wang, Weiqi Luo, Xiaojun Jia
arXiv:2606. 19380v3 Announce Type: replace-cross Abstract: Software engineering and deployment are increasingly delegated to AI coding agents.
By Kenneth Ge, Andre Assis
The paper introduces CUAHarm, a benchmark comprising 104 expert‑written realistic misuse scenarios for computer‑using agents (CUAs), such as disabling firewalls or leaking data. Using a sandbox with verifiable rewards, the authors evaluate frontier language models—including GPT‑5, Claude 4 Sonnet, Gemini 2.5 Pro, Llama‑3.3‑70B, and Mistral Large 2—and find that even without jailbreak prompts, these models can successfully execute many malicious tasks at high rates (e.g., 90% for Gemini 2.5 Pro). The study also shows that newer models, while safer in traditional safety benchmarks, exhibit higher misuse risks as CUAs, and that monitoring CUAs’ actions remains challenging, with current methods achieving only about 77% accuracy.
By Aaron Xuxiang Tian, Ruofan Zhang, Janet Tang, Ji Wang, Tianyu Shi, Jiaxin Wen
arXiv:2605.29442v2 Announce Type: replace-cross
Abstract: AI coding agents increasingly act directly within software environments, yet existing analyses of their failures rely on benchmark trajectori...
By Ningzhi Tang, Chaoran Chen, Gelei Xu, Yiyu Shi, Yu Huang, Collin McMillan, Tao Dong, Toby Jia-Jun Li
arXiv:2604.20779v2 Announce Type: replace
Abstract: AI coding agents are being adopted at scale, yet we lack empirical evidence on how people actually use them and how much of their output is useful...
By Joachim Baumann, Vishakh Padmakumar, Xiang Li, John Yang, Diyi Yang, Sanmi Koyejo