← Back to all news
arXiv Computation and Language By Chenrui Cui, Hongye Fang, Lisha Song, Weichao Chen, Yue Zhu, Gang Xu

Benchmarking LLM Compliance with China AI Generated Content Regulations

Read the original on arXiv Computation and Language →

The paper "Benchmarking LLM Compliance with China AI Generated Content Regulations" presents a new framework for evaluating large language models (LLMs) against China’s AI‑generated content compliance rules. Using 2,303 questions across six dimensions—including 203 self‑constructed constitutional queries—the authors assess 20 prominent LLMs, finding that international models show high compliance, especially on ideologically aligned dimensions. The study establishes a regulatory benchmark that allows the global AI community to test both Chinese and non‑Chinese LLMs under unified, legally grounded compliance criteria.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Computation and Language.

Related stories

arXiv AI
4d ago

An LLM-Based Agent for Legal Compliance Assessment: Architecture, Memory, and Evaluation in a Canadian and Quebec Context

The paper introduces ComplianceAgent, a legal compliance sub‑agent within the COMPASS multi‑agent framework, which uses a large language model to evaluate texts on a fixed rubric across digital sovereignty, carbon impact, compliance, and ethics. The agent grounds its judgments in a reference legal corpus, and if a text scores at or below a critical threshold, it initiates a corrective chain that includes self‑healing rewrites, a compliance label, an explainability report, and escalation to a human reviewer. The authors evaluate the agent in a Canadian and Quebec context on a corpus of thirteen legal instruments and a hand‑annotated gold standard of fifteen texts, demonstrating perfect separation of conforming versus non‑conforming texts, stable scores under repeated queries, and relevant passage retrieval.

By Soukaina Alaoui Ismaili, Jean-Sebastien Dessureault
llmsagents
More like this →
arXiv AI
Oct 15

UDHRBench: Benchmarking Human Rights in Large Language Models

arXiv:2610.15179v1 Announce Type: cross Abstract: Large language models are increasingly deployed in contexts requiring adherence to ethical and legal norms, yet their alignment with internationally...

By Alak Raad (Hamad Bin Khalifa University, Qatar), Noreldin Morssy (Hamad Bin Khalifa University, Qatar), Zeerak Suhail (Hamad Bin Khalifa University, Qatar), Serin Atiani (Princess Sumaya University for Technology, Jordan), Mustafa Jarrar (Hamad Bin Khalifa University, Qatar)
llmsbenchmarkssafety
More like this →