AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,808 stories · RSS feed

arXiv Computation and Language
Sep 15

An Empirical Analysis of Factual Errors in Human-Written Text and Its Application to Factual Error Detection

The paper presents an empirical study of factual errors in human-written text, focusing on corrections in newspaper articles to build a taxonomy of common mistakes such as kanji misconversions and unit errors. It evaluates large language models’ ability to detect these errors, finding that even advanced models like GPT‑5.4 achieve only a 52% word‑level F1 score on synthetic data, underscoring the difficulty of the task. The work highlights the gap in research on factual error detection in human writing compared to LLM hallucinations.

By Kazuma Iwamoto, Kazumasa Omura, Shotaro Ishihara
arXiv AI
Sep 15

Governing at Machine Speed: An Adaptive Intelligence Architecture for Real-Time AI Policy Enforcement

The paper "Governing at Machine Speed: An Adaptive Intelligence Architecture for Real-Time AI Policy Enforcement" highlights a gap in enterprise AI governance, where 78% of organizations lack auditable evidence of policy enforcement. It introduces AGIL, a five-layer adaptive governance architecture that uses machine learning for real-time detection, risk classification, sub-100ms policy enforcement, continuous attestation, and policy evolution. The authors argue that the failure is organizational and architectural, not technical, and call for future empirical validation of AGIL.

By Sandeep Bokkasam, B. Durgalakshmi
arXiv AI
Sep 15

Another Blueprint In The Wall: How to Ask Frontier AI Like a Kid?

The paper reports experiments with six frontier AI models from OpenAI, Anthropic, xAI, and Google DeepMind, using ten independent sessions per model type and a three‑stage prompt sequence that shifts from architectural preference to a full ASCII backbone. Under a school‑audience framing, responses consistently converged on a shared architectural pattern featuring persistent latent state, adaptive computation, memory, specialist routing, verification, stopping control, and delayed decoding, while removing the framing led to more heterogeneous results. A notable observation is the close overlap between GPT‑5.6 Sol’s elaborate successor architecture and GPT‑6 Astra’s independently sketched design, raising questions about shared design priors or independent convergence.

By Afshin Khadangi
arXiv Machine Learning
Sep 15

Isolation-based Spherical Ensemble Representations for Tabular Anomaly Detection

The paper introduces ISER, an isolation-based method for unsupervised tabular anomaly detection that uses hypersphere radii to encode local density and maintains linear time and constant space complexity. ISER builds ensemble representations where smaller radii indicate dense regions and larger radii indicate sparse regions, and it employs a similarity-based scoring method that compares these representations to a theoretical anomaly reference pattern. Experiments on 20 real-world datasets show that ISER outperforms 12 state‑of‑the‑art methods, including an enhanced Isolation Forest.

By Yang Cao, Sikun Yang, Hao Tian, Kai He, Lianyong Qi, Ming Liu, Yujiu Yang, Hong-Kun Zhang
arXiv AI
Sep 15

OptoAgent: A Trustworthy Multi-Agent Framework for Opportunistic Vision Micro-Screening in Classroom Environments

OptoAgent is a multi‑agent framework called SightSentinel that transforms a classroom wall display into a continuous vision screening tool. It embeds short, calibrated optotype probes into ordinary educational content, and eight specialized agents analyze each encounter to recover viewing distance, recognition accuracy, gaze stability, and other metrics. A quality agent filters out poor data, a longitudinal agent builds a child‑specific baseline, and an orchestrator produces a Vision Concern Score that is routed through a safety gate to avoid diagnosis or prescription. "whyItMatters":"The system aims to detect vision problems earlier and more reliably than periodic school screenings by leveraging everyday classroom interactions and automated, low‑cost data collection."

By Toqeer Ali Syed, Ali Akarma, Adeel Ahmad, Hammad Muneer
arXiv Computer Vision
Sep 15

RxScribe Bench: A Multi-Axis Benchmark for Evaluating Vision-Language Models on Indian Outpatient Prescriptions

arXiv:2609.13280v1 Announce Type: new Abstract: Prescription transcription errors are not interchangeable. A model that fabricates a drug and a model that misreads a legible dose pose very different...

By Somil, Vijay Saini, Vidit Verma, Riya, Aastha Batta, Vibhuti Malhotra, Chayan Khetan, Piyush Mittal, Puneet Poonia