arXiv AI

GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysis

arXiv:2609. 03553v1 Announce Type: new Abstract: Policy analysis requires more than predicting whether a proposal will pass: it requires identifying who will be affected, how those actors respond, and what follows.

arXiv AI
Oct 2

Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents

The paper proposes a claim‑specific verification audit for modular agents that replaces aggregate task scores with evidence‑based evaluations. Each agent conclusion is recorded with supporting evidence and classified as supported, unsupported, unresolved, or not evaluated, along with the boundary of validity. The audit employs three tools—oracle policies, perfect component replacements, and verifier‑score tests—to trace value changes, locate lost value, and assess verifier effectiveness, demonstrated on a portfolio‑allocation agent in a synthetic market.

By Ali Atiah Alzahrani
arXiv AI
Jun 4

Parthenon Law: A Self-Evolving Legal-Agent Framework

arXiv:2606. 04602v1 Announce Type: new Abstract: As agents grow more capable, legal-domain LLM agents promise to turn document-heavy matters into reviewable work products -- yet reliable deployment faces three obstacles: no large-scale evidence on how today's strongest model-and-harness combinations behave on end-to-end legal matters; no agent architecture adapted to the legal vertical, only general-purpose harnesses; and, in a setting that keeps shifting with new facts, authorities, and deadlines, no mechanism for systems to learn from their own outcomes.

By Hejia Geng, Leo Liu
arXiv AI
2d ago

Governance-Aware Federated Learning for Multi-Agent AI Systems: A Policy-Driven Framework for Trustworthy Collaborative AI

The paper introduces Governance-Aware Federated Learning (GAFL), a framework that enhances traditional federated learning with independent governance verification, fairness and explainability assessment, anomaly detection, policy enforcement, and tamper‑evident audit logging. In a cross‑silo prototype with 10 participants, GAFL successfully identified all falsified‑evidence participants and intervened on affected participants across various threat scenarios, achieving macro‑F1 scores between 0.7520 and 0.7733. The added governance processing time per round was 173.67 ± 26.94 ms, compared to 3.82 ± 0.79 ms for standard FedAvg, highlighting a trade‑off between fairness policy enforcement and utility.

By Kiranmayee Janardhan, Karthick S, Madhusmita Panda, Bharathi Vokkaliga Ganesh, Syed Ahmed
arXiv AI
Aug 13

Governing Agentic AI in FinTech

arXiv:2608. 11344v1 Announce Type: cross Abstract: Financial institutions are delegating consequential decisions to agentic AI systems that decompose goals, coordinate models and tools, and act with little oversight.

By Henry Han
arXiv AI
Sep 25

PAWS: Policy-driven Agentic World Simulation

PAWS is a new dataset for policy-driven agentic world simulation that covers 36 verified U.S. financial and economic policy episodes. It includes 12,727 policy-linked news records and 65,291 stakeholder actions, each linked to supporting news and represented by a multi-layer event frame with interaction mode, financial-action family, semantic attributes, and taxonomic mappings. The dataset aligns actions with daily market-return context and has been validated by AI and human reviewers, demonstrating high agreement on interaction mode and revealing challenges in detecting rare stakeholder actions.

By Tiviatis Sim, Jia Hui Woon, Xinming Gao, Chen Gao, Fengbin Zhu, Zheng Huanhuan, Chua Tat Seng, Kenji Kawaguchi
arXiv AI
Oct 7

Confidence Reasoning Graphs: Structured Confidence Estimation for LLM Agents

The paper introduces Confidence Reasoning Graphs (CRGs), an inference-time framework that estimates the probability an LLM agent has successfully completed its task using a single trajectory without requiring privileged model access or training data. CRGs decompose the agent’s overall claim of success into contextualized sub-claims, estimate confidence for each terminal claim based on trajectory evidence, and aggregate these into an overall confidence estimate. Experiments across multiple benchmarks, models, and agent frameworks show that CRGs produce better-calibrated confidence and more effective risk-aware decision making than existing verbalized, sampling-based, and white-box surrogate methods, while also providing transparent, auditable evidence for each estimate.

By Brendan King, Farima Fatahi Bayat, Jean-Flavien Bussotti, Pouya Pezeshkpour, Estevam Hruschka