arXiv AI

Judging Before Propagation: Task-Graph Contextual Integrity for Multi-Agent Privacy

The paper introduces Task-Graph Contextual Integrity (TG‑CI), a formalism that extends traditional Contextual Integrity to multi‑agent systems by modeling workflows as Multi‑Agent Task Graphs (MATGs). TG‑CI evaluates privacy not just at individual disclosures but across the entire downstream propagation, offering two enforcement policies—Full‑Scope and Auto‑Region—that balance privacy protection with task performance. A new benchmark, MAPLE‑Bench, demonstrates that TG‑CI can cut unauthorized disclosures by up to 94% while preserving over 94% of task accuracy compared to existing local‑history CI methods.

arXiv Machine Learning
21h ago

PrivacyFlow: Privacy in AI Agents through Information Flow Analysis and Consequence-Aware Risk Management

PrivacyFlow introduces a new benchmark, PrivacyBench, and a defense system that separates privacy planning from task execution in autonomous LLM agents. The system traces data provenance, models recipient knowledge, and simulates inference attacks to weigh disclosure risk against task utility, allowing it to minimize or block data sharing. Experiments show that PrivacyFlow reduces privacy failures and increases completed task sequences by 22–55 percentage points, while revealing a tradeoff between privacy, utility, and user autonomy.

By Robin Staab, Tom Wollschl\"ager, Vahab Mirrokni, Reza Shokri
arXiv AI
Oct 26

MCPHunt: An Evaluation Framework for Cross-Boundary Data Propagation in Multi-Server MCP Agents

MCPHunt is a benchmark framework that isolates non‑adversarial credential propagation across multi‑server MCP trust boundaries. It uses canary‑based taint tracking, a controlled coverage design with risky, benign, and hard‑negative conditions, and completion‑requires‑secret stratification to separate faithful from policy‑violating propagation. Across 3,615 traces from 5 models, policy‑violating propagation rates range from 11.5 % to 41.3 %, with mitigation via prompting reducing rates to 0.3 % while retaining 80.5 % utility.

By Haonan Li, Tianjun Sun, Yongqing Wang, Qisheng Zhang
arXiv AI
Oct 2

Deny Without Disabling: Authorization-Paired Evaluation and Control for Multi-Agent Systems

The paper introduces authorization‑paired evaluation and the FlowReview framework to address safety issues in multi‑agent systems where shared evidence can enable prohibited uses. By jointly enforcing blocking of prohibited actions and completion of authorized ones, FlowReview connects object resolution, permission ranking, and deterministic enforcement. Experiments show that reviewing combined artifacts can eliminate denied‑commit rates without sacrificing authorized supply, highlighting the need to link object identity and permission to execution for safe collaboration.

By Yunbei Zhang, Saiyue Lyu, Janet Wang, Yingqiang Ge, Jiang Guo, Jihun Hamm, Chandan K Reddy
Hugging Face Trending Papers
Aug 3

MNC: Scope-Bound Semantic Declassification for Private LLM-Agent Communication

Multi-agent large language model (LLM) systems can expose protected state through internal messages, tool arguments, logs, and persistent memory even when their public outputs appear innocuous. Existing privacy prompts, redaction methods, and source-level access controls restrict surface content or data access, but do not specify what a legitimately informed agent should disclose or how that disclosure may be reused downstream.