Human oversight is a pillar of AI safety. It is often exercised by a human in the loop (HITL) who approves critical actions taken by an AI agent. AI agents' increasing ability to bypass guardrails, th...
The paper examines the security challenges of delegating authority to autonomous LLM agents that act on users’ behalf. It introduces a threat model with four adversaries and eight security requirements, demonstrates that current frameworks (LangGraph, CrewAI, AutoGen, MCP) fail to meet these standards, and presents an authorization broker that blocks all identified threats with minimal overhead. The broker is shown to resist numerous attacks and limits compromised sub‑agents to their delegated tasks, and its principles are implemented in VotalAI’s LLM Shield.
By Panduranga Sai Varma Dantuluri, Jyotirmoy Sundi
arXiv:2606. 26057v1 Announce Type: cross Abstract: AI agents are granted access to tools, APIs, and other infrastructure, making them active principals in those systems.
By Seth Dobrin, {\L}ukasz Chmiel
arXiv:2610.27620v1 Announce Type: cross
Abstract: Autonomous LLM agents act through tools under per-action authorization: a local guard screens each tool call in isolation. We show that local authori...
By Anmol Pandey, Aditya Jain, Liang Chen, Carsten Maple
arXiv:2602. 20064v2 Announce Type: replace-cross Abstract: Large language models are increasingly deployed as agents: they plan, call tools, read untrusted data, and act on the results.
By Zac Garby, Andrew D. Gordon, David Sands
PerMIT is a memory architecture that provides provable integrity guarantees for persistent memory used by large language model agents. It limits trust to user‑typed inputs and values confirmed at a gate, mediating untrusted environment‑derived values through a finite interface while preserving multi‑turn planning and tool choice. Two machine‑checked integrity theorems in Lean 4 ensure that only gate‑confirmed data can influence sensitive actions, and community endorsements can accumulate to reduce verification effort as the user base grows.
By Tanqiu Jiang, Min Bai, Sadat Shahriar, Wanyu Du, Sandesh Swamy