AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,884 stories · RSS feed

arXiv AI
Aug 25

Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundations

arXiv:2507.04356v3 Announce Type: replace-cross Abstract: Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This...

By Vyacheslav Kungurtsev, Alessandro Di Frenna, Gustav Sir, Monicah Cherop Naibei, Haozhe Tian, Homayoun Hamedmoghadam, Akhil Anand, Sebastien Gros
arXiv Computation and Language
Aug 25

FourierSampler: Unlocking Non-Autoregressive Potential in Diffusion Language Models via Frequency-Guided Generation

arXiv:2601.23182v2 Announce Type: replace Abstract: Despite the non-autoregressive potential of diffusion language models (dLLMs), existing decoding strategies demonstrate positional bias, failing to...

By Siyang He, Qiqi Wang, Xiaoran Liu, Hongnan Ma, Yiwei Shi, Yuerong Song, Ying Zhu, Tianyi Liang, Zengfeng Huang, Ziwei He, Xipeng Qiu
arXiv Computer Vision
Aug 25

Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds

arXiv:2608.23383v1 Announce Type: new Abstract: Video generation is progressing beyond isolated clips toward long-form narratives and interactive worlds, requiring models to preserve identities, foll...

By Nan Duan, Haoyang Huang, Weiyang Jin, Haoran Li, Yaowei Li, Yuming Li, Yijun Liu, Xin Lu, Xiaoxiao Ma, Yanwen Ma, Yaofeng Su, Yilang Sun, Haoyu Wang, Zeyue Xue, Songchun Zhang, Junhao Zhuang
arXiv AI
Aug 25

Vibe Coding on Trial: Operating Characteristics of Unanimous LLM Juries

The paper evaluates using large language model (LLM) juries to review code generated from natural language queries, focusing on MySQL text-to-SQL tasks. It benchmarks 15 open models, selects the top six, and constructs unanimous committees of varying sizes to accept a query only when all members agree. The study finds that single-model judges are inconsistent, while small unanimous committees of strong models can reduce false accepts without discarding many correct queries, and that committee composition significantly influences performance.

By Muhammad Aziz Ullah, Abdul Serwadda
arXiv Computation and Language
Aug 25

Scaling Electronic Health Record Foundation Models for Population Health Management

The paper introduces Scaling Electronic Health Record Foundation Models for Population Health Management, a large‑scale model trained on billions of medical events from over 5 million patients in Taiwan and the United States. By aligning ICD codes across different health systems, the model achieves strong scaling and generalization across 11 chronic disease prediction tasks, outperforming tree‑based, general, and biomedical language models with high sensitivity at 99% specificity. It also demonstrates superior few‑shot performance on the EHRShot benchmark and shows that cross‑system alignment provides a stronger pretraining signal than single‑site duplication in data‑limited scenarios.

By Liwen Sun, Hao-Ren Yao, Ophir Frieder, Xiang Qian, Chenyan Xiong
arXiv Computer Vision
Aug 25

Where Not to Learn: Prior-Aligned Training with Subset-based Attribution Constraints

arXiv:2602.07008v5 Announce Type: replace Abstract: Reliable models should not only predict correctly, but also base their decisions on acceptable evidence. However, conventional supervised learning...

By Ruoyu Chen, Shangquan Sun, Xiaoqing Guo, Kangwei Liu, Sanyi Zhang, Zhangcheng Wang, Shiming Liu, Qunli Zhang, Wei Wang, Hua Zhang, Xiaochun Cao
arXiv Computer Vision
Aug 25

LangDriveCTRL: Natural Language Controllable Driving Scene Editing with Multi-modal Agents

LangDriveCTRL is a natural‑language‑controllable framework that edits real‑world driving videos by representing each video as an explicit 3D scene graph, separating a static background from dynamic object nodes. It employs a feedback‑driven agentic pipeline where an Orchestrator translates user instructions into executable graphs that coordinate specialized multi‑modal agents—Object Grounding, Behavior Editing, and Behavior Reviewer—to align text with scene nodes, generate and refine multi‑object trajectories, and ensure photorealism through a video diffusion tool and Video Reviewer. The system supports object node editing (removal, insertion, replacement) and multi‑object behavior editing, achieving nearly twice the instruction alignment of prior state‑of‑the‑art methods while preserving photorealism, structural integrity, and traffic realism.

By Yun He, Francesco Pittaluga, Ziyu Jiang, Matthias Zwicker, Manmohan Chandraker, Zaid Tasneem