AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,808 stories · RSS feed

arXiv Computer Vision
Sep 21

ALINA: Advanced Line Identification and Notation Algorithm

arXiv:2406.08775v2 Announce Type: replace Abstract: Labels are the cornerstone of supervised machine learning algorithms. Most visual recognition methods are fully supervised, using bounding boxes or...

By Mohammed Abdul Hafeez Khan, Parth Ganeriwala, Siddhartha Bhattacharyya, Natasha Neogi, Raja Muthalagu
arXiv Computation and Language
Sep 21

Boosting Deepresearch and LongContext Ability with Self-Generated Deepresearch Rollouts Traces

arXiv:2609.20844v1 Announce Type: new Abstract: Deepresearch (DR) agents interact with real-world web environments through multi-turn search and visit, causing their contexts to grow rapidly over tim...

By Zihan Wang, Hao Wang, Boyuan Jiang, Yiqun Zhang, Shi Feng, Xiaocui Yang, Yiwen Ye, Jianghang Lin, Xiaozhong Ji, Jinghao Lin, Kai Wu
arXiv AI
Sep 21

Auditing a KB Elicitation of Frontier LLM Knowledge: A Multi-dimensional Analysis of GPTKB v1.5

The paper presents a framework and results of a multi-dimensional analysis of GPTKB v1.5, a 100‑million‑fact knowledge base elicited from GPT‑4.1. It shows that the LLM’s factual knowledge differs markedly from established knowledge bases and that its accuracy is lower than suggested by prior benchmarks. The study also identifies inconsistency, ambiguity, and hallucinations as major issues, pointing to future research directions in neuro‑symbolic AI for extracting, consolidating, and verifying factual LLM knowledge.

By Shrestha Ghosh, Luca Giordano, Yujia Hu, Tuan-Phong Nguyen, Simon Razniewski
arXiv Machine Learning
Sep 21

The Binary Tree Mechanism is Optimal for Differentially Private Continual Counting

arXiv:2607. 00876v3 Announce Type: replace-cross Abstract: Private continual counting is a fundamental problem in differential privacy: given a binary stream of length $n$, where each $1$ corresponds to the contribution of one individual, the goal is to release all running counts while protecting the privacy of each individual.

By Konstantina Bairaktari, Markus Engelund Dahl, Kasper Green Larsen
OpenAI Blog
Sep 18

Introducing the Australian Youth Safety Blueprint

OpenAI has announced the Australian Youth Safety Blueprint, a six-pillar roadmap designed to create safer AI experiences for young people. The initiative aims to protect and empower youth by outlining specific safety measures and guidelines. It represents a focused effort to address the unique needs and risks faced by younger users of AI technology.

arXiv Computation and Language
Sep 18

LaSR: Context-Aware Speech Recognition via Latent Reasoning

LaSR (Latent Speech Reasoning) is a new training paradigm for context‑aware speech recognition that uses a latent reasoning trajectory instead of explicit intermediate tokens. It aligns chain‑of‑thought supervision around the acoustic region of target words and introduces latent reasoning periods for grounding context and guiding transcription transitions. Experiments on Fun‑Audio‑Chat show that LaSR improves terminology recognition without added latency and outperforms standard fine‑tuning baselines, demonstrating the promise of latent reasoning for efficient, context‑aware speech assistants.

By Heyang Liu, Ziyang Cheng, Jiayi Huang, Wenyang Xiao, Ronghua Wu, Qunshan Gu, Yanfeng Wang, Yu Wang
arXiv Computation and Language
Sep 18

Decoupled Contrastive Decoding via Expert-Aligned Drafting

The paper introduces Decoupled Contrastive Decoding (DCD), a method that separates drafting from verification in contrastive decoding. DCD uses an expert‑aligned lightweight proposer for drafting and applies contrastive correction only during verification, preserving the vanilla contrastive decoding distribution. Experiments on 8B models show that DCD achieves 1.65–1.95× speedups in greedy decoding and reduces MMLU proposal‑path latency by 5–12× compared to amateur‑coupled approaches.

By Zhixuan Liu, Zhichen Dong, Yuanfu Wang, Chao Yang
arXiv Computation and Language
Sep 18

UniPolicy: Unified Objective-Specific Policies for Generative Search Advertising

UniPolicy is a unified objective‑specific policy framework for search advertising that jointly optimizes relevance, click propensity, and commercial value. It uses objective‑aware prefix tokens, sparse MoE‑LoRA routing, and residual FFNs to decouple parameters within a shared backbone, and constructs pairwise preferences from multi‑stage behavioral feedback to strengthen clicked candidates. In large‑scale offline tests and a 7‑day online A/B test, UniPolicy improves CTR by 0.71%, RPS by 1.58%, and advertising revenue by 1.32% while keeping serving latency stable.

By Kun Yao, Yuhang Zhou, Yichi Zhang, Zeliang Tong, Shengri Xue, Haitao Wang, Siyu Lu, Qianlong Xie, Xingxing Wang
arXiv Computation and Language
Sep 18

Benchmarking LLM Compliance with China AI Generated Content Regulations

The paper "Benchmarking LLM Compliance with China AI Generated Content Regulations" presents a new framework for evaluating large language models (LLMs) against China’s AI‑generated content compliance rules. Using 2,303 questions across six dimensions—including 203 self‑constructed constitutional queries—the authors assess 20 prominent LLMs, finding that international models show high compliance, especially on ideologically aligned dimensions. The study establishes a regulatory benchmark that allows the global AI community to test both Chinese and non‑Chinese LLMs under unified, legally grounded compliance criteria.

By Chenrui Cui, Hongye Fang, Lisha Song, Weichao Chen, Yue Zhu, Gang Xu
arXiv Computation and Language
Sep 18

HerHealthEval: Evaluating Multilingual and Register-Sensitive Understanding of Women's Health Communication

HerHealthEval is a controlled evaluation framework that tests multilingual understanding of women's-health communication across English, French, and Modern Standard Arabic. It provides six communicative forms—canonical, clinical, layperson, indirect or hedged, emotionally concerned, and deliberately under-specified—each conveying the same clinical concern except the under-specified form omits details to assess clarification needs. The study evaluates multilingual instruction models and QLoRA-adapted variants on tasks such as concern classification, risk calibration, clarification behavior, parse compliance, and cross-form consistency, revealing that high aggregate accuracy can mask safety-relevant failures and that language-invariant risk labels improve performance.

By Hassan Saeed Hassan Albattra, Mazen Mohammed Bahgat, Rahatara Ferdousi, Hana Essam Sayed Ahmed Amrya, Mariam Mousa
arXiv Computation and Language
Sep 18

A Cross-Lingual Acoustic Disease-Alignment Framework for Respiratory Health Assessment from Spontaneous Speech

The paper introduces CL-DAF, a Cross‑Lingual Disease‑Alignment Framework that identifies acoustic features whose disease effects are consistent across languages. Using data from 201 English and 75 Bangla speakers, the authors construct a 272‑dimensional acoustic representation and find that 133 features reverse disease direction between languages, leading to poor cross‑lingual transfer (AUC 0.49). By isolating 26 disease‑aligned features, CL‑DAF improves cross‑lingual classification, achieving AUCs of 0.825 (English to Bangla) and 0.722 (Bangla to English).

By Roksana Khanom, Raghib Asfak Tasnim, Bodrun Nahar Bithi, Shafia Shirin Supty, Saiful Islam Raju, Ashok Agrawala, Nirupam Roy