arXiv Machine Learning

Evaluating Behavioral Context for Interpretable IAM Policy Risk Scoring in Cloud Environments

arXiv AI
Jun 9

Semantic Quorum Assurance: Collective Certification for Non-Deterministic AI Infrastructure

arXiv:2606. 08021v1 Announce Type: cross Abstract: As large language model (LLM) agents are integrated into autonomous cloud operations, distributed systems face a semantic reliability problem: proposer agents can generate production mutations, such as modifying IAM policies, opening firewall security groups, or executing data exports, that are syntactically valid and statically authorized but operationally unsafe.

By Jun He, Deying Yu
arXiv AI
Sep 17

PACT: Can Enterprise AI Assistants Be Trusted Under Pressure?

The paper introduces PACT, a benchmark designed to evaluate how well enterprise AI assistants follow compliance rules when faced with various pressures such as persistent users or hurried managers. PACT covers twelve regulated domains and forty-eight realistic multi‑turn scenarios, pairing each rule with a shortcut that violates it and applying different pressures across wording and system‑prompt modes. Using PACT, the authors profile six metrics of compliance and aggregate them into a PACTScore, revealing significant variability among 22 LLM models and that even top performers misapply rules 6–10% of the time, with user pressure increasing violations by 65% on average.

By Mika Okamoto, Ansel Kaplan Erol
arXiv AI
Sep 4

Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation

The paper presents a unified framework for proactive service agents, defining proactivity as an agent’s ability to infer service opportunities from incomplete signals and decide whether to remain silent, ask, assist, or act. It models this as a partially observable sequential decision process constrained by authorization and risk, integrating timing, content, and delivery into a single structured action. The authors categorize existing methods along a decision pipeline—state and need estimation, intervention gating, action construction, and feedback adaptation—and propose standardized metrics for evaluating triggering, timing, calibration, user burden, safety, and policy value across diverse interaction modalities.

By Yan Tang, Tingyu Cao, Yuanbo Tang, Huaze Tang, Keer Hu
arXiv AI
4d ago

Assurance-Conditioned Continuous Authorization for Autonomous AI Agents

The paper introduces Assurance-Conditioned Continuous Authorization (ACCA), a framework that maintains operational authority for autonomous AI agents by separating evidence validity from contextual applicability. ACCA derives assurance claims from eligible evidence, resolves a multidimensional effective-authority envelope, and uses a typed dependency graph for selective re‑evaluation of authorization‑relevant changes. The authors demonstrate the approach with controlled scenario tests in a trading domain, showing implementation‑level evidence for the method’s effectiveness.

By Mehdi Shajari