AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,884 stories · RSS feed

arXiv AI
Aug 25

Cross-lingual Biography Enrichment via Claim Extraction and Alignment

The paper introduces CLAW-4L, a benchmark of 300 pairs of English and non‑English Wikipedia biographies (French, Chinese, Azerbaijani) focused on women from non‑English contexts, complete with claim annotations and a fine‑grained claim‑pair relation corpus. It proposes a claim‑based enrichment framework that extracts claims from both biographies, aligns them to identify enrichment evidence from the non‑English version, and rewrites the English biography accordingly. Experiments demonstrate that non‑English Wikipedia biographies can improve English biography coverage, though lower‑resource settings still pose challenges.

By Yifei Song, Ziyang Chen, Emil Sayilov, Claire Gardent
arXiv Computer Vision
Aug 25

When the Edit Changes the Patient: Measuring Identity Preservation in Counterfactual Retinal Images

arXiv:2608.23024v1 Announce Type: new Abstract: Counterfactual medical image generation aims to modify an existing image to reflect a hypothetical scenario in which certain characteristics of the ima...

By Andrea Posada, Wenke Karbole, Bach Ngoc Doan, Alexander Weers, Solmaz Abdolrahimzadeh, Maria Patsiamanidi, Kahkashan Haider, Vaishali Khare, Daniel Rueckert, Andrew Lotery, Sobha Sivaprasad, Martin J. Menten
arXiv Computer Vision
Aug 25

SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Space

SketchFlow is a new generative framework for creating high‑quality vector sketches from text prompts. It uses a Gaussian Mixture Model prior in the CLIP latent space and an Optimal Transport Conditional Flow Matching model to map this prior to sketch features, which are then decoded by a Hybrid Diffusion Decoder combining 1D U‑Net and Transformer architectures. The approach achieves superior visual quality and human‑like drawing styles, and supports zero‑shot synthesis for unseen concepts and smooth semantic interpolation.

By Jin Zhou, Hongliang Yang, Pengfei Xu, Hui Huang
arXiv AI
Aug 25

Robust Multi-Agent Reinforcement Learning for Small UAS Separation Assurance under GPS Degradation and Spoofing

The paper presents a robust multi‑agent reinforcement learning framework for small unmanned aircraft systems (sUAS) to maintain separation assurance when GPS data is degraded or spoofed. By modeling state observation corruption as a zero‑sum game, the authors derive a closed‑form adversarial perturbation that eliminates iterative inner optimization and can be evaluated in linear time. Integrating this perturbation into a policy‑gradient MARL algorithm yields a counter‑policy that achieves near‑zero collision rates in high‑density simulations even with up to 35% observation corruption, outperforming non‑adversarial baselines.

By Alex Zongo, Filippos Fotiadis, Ufuk Topcu, Peng Wei