AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

11,407 stories · RSS feed

arXiv AI
Jun 3

vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models

arXiv:2603. 04444v3 Announce Type: replace-cross Abstract: As large language models (LLMs) diversify across modalities, capabilities, and cost profiles, the problem of intelligent request routing -- selecting the right model for each query at inference time -- has become a critical systems challenge.

By Xunzhuo Liu (Steve), Huamin Chen (Steve), Samzong Lu (Steve), Yossi Ovadia (Steve), Guohong Wen (Steve), Hao Wu (Steve), Zhengda Tan (Steve), Jintao Zhang (Steve), Senan Zedan (Steve), Yehudit Kerido (Steve), Liav Weiss (Steve), Haichen Zhang (Steve), Bishen Yu (Steve), Asaad Balum (Steve), Noa Limoy (Steve), Abdallah Samara (Steve), Baofa Fan (Steve), Brent Salisbury (Steve), Ryan Cook (Steve), Zhijie Wang (Steve), Qiping Pan (Steve), Rehan Khan (Steve), Avishek Goswami (Steve), Houston H. Zhang (Steve), Shuyi Wang (Steve), Ziang Tang (Steve), Fang Han (Steve), Zohaib Hassan (Steve), Jianqiao Zheng (Steve), Avinash Changrani (Steve), Xue (Steve), Liu, Bowei He
arXiv AI
Jun 3

Echelon: Auditable Aggregate-Only Language-Model Adaptation Across Privacy Boundaries

arXiv:2606. 02958v1 Announce Type: cross Abstract: Cross-organization language-model adaptation increasingly faces hard governance constraints: in many deployments, device-level model state-parameters, activations, optimizer state, and per-device updates-cannot be exported outside an administrative boundary.

By Hina Dixit, Punit Kumar, Irene Tenison, Nevasini Sasikumar
arXiv Machine Learning
Jun 3

VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring

arXiv:2606. 03954v1 Announce Type: cross Abstract: As AI systems increasingly assist humans in physical tasks, ensuring safety becomes paramount -- physical actions carry immediate and irreversible consequences that digital errors do not.

By Hanjiang Hu, Yiyuan Pan, Jiaxing Li, Xusheng Luo, Alexander Robey, Na Li, Yebin Wang, Changliu Liu
arXiv AI
Jun 3

TASTE: A Designer-Annotated Multi-Dimensional Preference Dataset for AI-Generated Graphic Design

arXiv:2605. 20731v2 Announce Type: replace-cross Abstract: Text-to-image models now generate graphic design at production scale, yet their supervision still comes primarily from photo-style preference datasets with a single overall verdict per comparison.

By Haonan Zhu, Elad Hirsch, Alexandria Minetti, Allison Nulty, Purvanshi Mehta
arXiv AI
Jun 3

Which Defense Closes Which Threat? Attributing OWASP-LLM-Top-10 Coverage and Its Brittleness Under Paraphrasing

arXiv:2606. 02822v1 Announce Type: cross Abstract: Production LLM applications stack several defense families -- refusal-phrase filters, token-budget controls, model allowlists, rate limits, tool-registry authentication -- yet existing breach-and-attack-simulation (BAS) benchmarks report a single aggregate coverage number, hiding which family closes which threat.

By Alexandre Cristov\~ao Maiorano
arXiv Machine Learning
Jun 3

Fairness Definitions and Metrics in Deep Reinforcement Learning for Drug Discovery in Healthcare: A Rapid Evidence Review

arXiv:2606. 02902v1 Announce Type: cross Abstract: Deep reinforcement learning (DRL) is increasingly applied to de novo molecular design, but choices in data, rewards, and evaluation can yield uneven performance across disease areas and chemotypes.

By Esmaeil Shakeri, Ronnie de Souza Santos, Behrouz Far
arXiv Machine Learning
Jun 3

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations

arXiv:2606. 03180v1 Announce Type: cross Abstract: Vision-language models (VLMs) for radiology have emerged as a scalable paradigm by leveraging image-report pairs naturally produced in clinical workflows.

By Jonggwon Park, Seongeun Lee, Junhyun Park, Hannah Yun, Hyunwoong Kim, Sohyun Jeong, Hyewon Kang, Byungmu Yoon, Kyoyun Choi