AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 21

Gated Prototype Transfer for Zero-Support Medical Vision Language Model

The paper introduces Gated Knowledge‑Guided Prototype Transfer (GProtoT), a training‑free module that enhances zero‑support medical vision‑language models by transferring visual residuals from supported classes to missing ones using VLM similarity and clinical ontology distances. GProtoT employs an evidence gate to scale transfer based on semantic relevance, reducing negative transfer while modestly improving recall and accuracy in realistic one‑shot trials on MESSIDOR. The method requires no gradients, validation data, or extra inference, offering a low‑compute, accountable adaptation path for incomplete clinical supervision.

By Sumaiya Fazal, Rizwan Qureshi, Laleh Behjat, Samira Ebrahimi Kahou
arXiv AI
Oct 21

BitMTP: When Multi-Token Prediction Meets Low-Bit Large Language Models

BitMTP is an algorithm‑system co‑design framework that combines multi‑token prediction (MTP) with ultra‑low‑bit large language model backbones to accelerate decoding while maintaining quality. It introduces joint next‑token and MTP objectives, multiple decoding modes (confidence‑only, speculative‑only, hybrid), and an accepted‑prefix alignment mechanism that keeps causal key‑value boundaries and CUDA Graph replay states consistent. Experiments on NVIDIA H20, RTX 3090, and Jetson Orin show speedups ranging from 2.0× to 3.3× across various ultra‑low‑bit models without sacrificing task performance.

By Ning Zhang, Shihao Wang, Jinrui Zhang, Chaodong Xiao, Lei Zhang
arXiv AI
Oct 21

A Survey of Generative Categories and Techniques in Multimodal Generative Models

The paper surveys multimodal generative models (MGMs), outlining six main text‑conditioned modalities and four key techniques—self‑supervised learning, mixture of experts, reinforcement learning from human feedback, and chain‑of‑thought prompting—used across them. It evaluates models on faithfulness, compositionality, and robustness, and reports four empirical findings about preference gains, reward optimisation, intermediate planning, and expert granularity. The study also discusses trustworthiness risks such as bias, privacy leakage, and media misuse, and reviews mitigation evidence.

By Longzhen Han, Awes Mubarak, Almas Baimagambetov, Nikolaos Polatidis, Thar Baker