arXiv Computation and Language By Louise Yorke

Beyond accuracy: what AI assurance needs to establish in public services

Read the original on arXiv Computation and Language →

The paper examines how public bodies use AI-generated evidence—such as classifications and summaries—to inform policy and service delivery, highlighting the need for rigorous testing and governance. Using eight GPT‑4o configurations on 1,200 UK Prime Minister’s Questions, the authors find modest accuracy (68.2–70.3%) but significant label disagreement and variable human‑review flags (0.9–41.0%). Analysis of UK and EU policy documents shows that while testing and oversight are mandated, reporting requirements often miss key issues like changing answers, shared errors, and review routing, underscoring gaps in current AI assurance practices.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

arXiv AI
Sep 18

Governance-as-Code: Translating EU AI Act Technical Requirements into Executable Compliance Pipelines for Generative AI Systems

The paper introduces Governance-as-Code (GaC), a framework that translates the EU AI Act’s technical requirements into 43 machine‑checkable acceptance criteria across six compliance modules. GaC runs within a CI/CD pipeline, producing Article‑indexed audit evidence and providing actual Rego policy code. The authors validate GaC on two enterprise deployments, showing it reproduces manual audit findings—including three penalty‑triggering violations—while reducing audit labor by about 75%.

By Rudrendu Kumar Paul, Sourav Nandy
Hugging Face Trending Papers
Aug 27

LAAF: A Layered Accountability Architecture Framework for LLM Applications

The paper presents LAAF, a Layered Accountability Architecture Framework for Large Language Model (LLM) applications, developed through a systematic review of 122 primary studies and 12 regulatory documents. It identifies five dimensions of accountability and four families of mechanisms—technical controls, human oversight, organisational governance, and documentation/traceability—each assessed for maturity. The framework is mapped onto major regulatory standards (EU AI Act, NIST AI RMF, ISO/IEC 42001) and highlights persistent gaps such as under‑specified human oversight and lack of shared accountability metrics.

arXiv AI
Aug 28

LAAF: A Layered Accountability Architecture Framework for LLM Applications

The paper introduces LAAF, a Layered Accountability Architecture Framework for Large Language Model (LLM) applications, developed through a systematic review of 122 primary studies and 12 regulatory documents. It identifies five accountability dimensions and four families of mechanisms—technical controls, human oversight, organisational governance, and documentation/traceability—evaluated across maturity levels. The framework maps onto major standards such as the EU AI Act, NIST AI RMF, ISO/IEC 42001, and sectoral guidance, highlighting gaps in human oversight, accountability metrics, disciplinary alignment, and empirical validation.

By Prachi Chaturvedi, Shahnawaz Ahmad, Ehsan Nowroozi, Muhammad Waqas, George Loukas, Alireza Jolfaei, Lucas Cordeiro, Pierre Dantas
arXiv AI
Aug 20

Global Index on Responsible AI 2026 : Conceptual Framework and Methodology

The Global Index on Responsible AI 2026 (GIRAI) 2nd Edition refines its predecessor by distinguishing between framework existence and implementation, expanding from three to five thematic areas, and adding granular variables for framework quality. It evaluates responsible AI governance across five dimensions—Inclusion and Diversity, Ethics and Sustainability, Labour and Skills, Trust and Safety, and Use of AI in Public Service—using 38 indicators organized into three pillars: AI Policy, CSO Engagement, and Enabling Conditions, plus a separate Use of Unacceptable Risk AI penalty. Data from 135 country-level researchers and secondary sources are normalized to a 100-point scale, weighted by pillar importance, and used to facilitate systematic cross‑national comparisons for policymakers, civil society, and AI developers.

By Fola Adeleke, Rachel Adams, Ayantola Alayande, Daniela Benavente, Ana Florido, Nicol\'as Grossman, Leah Junck