AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,808 stories · RSS feed

arXiv Computer Vision
Sep 16

Hub-Spectral Activation of Latent Multimodal Knowledge

arXiv:2609.17094v1 Announce Type: new Abstract: Multimodal representation learning seeks shared representations for cross-modal retrieval and knowledge transfer. Hub-based binding reduces pairwise su...

By Ying Guo, Haidong Chen, Linrui Xu, Xiaohao Liu, Chuancheng Shi, Canran Xiao, Dan Zhang, Fei Shen, Li Shen, Tat-Seng Chua
arXiv Machine Learning
Sep 16

Nationally Consistent, Locally Incomplete: A Bayesian Remote-Sensing Audit of Rooftop Photovoltaic Registries

The paper presents a Bayesian framework that uses remote sensing to estimate the true rooftop photovoltaic (PV) capacity, correcting for detector imperfections and providing uncertainty estimates. Applied to France, the method yields a 4.03 GWp estimate for rooftop PV below 36 kWp, aligning with transmission operator data within 3.3% nationally but revealing local under‑reports up to 61%. It also identifies a significant truncation bias in French open PV data, highlighting the need for more reliable capacity estimates worldwide.

By Gabriel Kasmi, Yves-Marie Saint-Drenan, Laurent Dubus, Philippe Blanc
arXiv Computation and Language
Sep 16

Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization

The paper introduces JudgeBiasBench, a benchmark that systematically quantifies judgment biases in large language model (LLM)-based judges across four dimensions and 12 bias types. It evaluates both generative and discriminative judges, revealing significant bias patterns that undermine reliability. The authors propose bias-aware training—reinforcement learning for generative judges and contrastive learning for discriminative judges—to reduce these biases while maintaining evaluation performance.

By Hongli Zhou, Hui Huang, Rui Zhang, Kehai Chen, Bing Xu, Conghui Zhu, Tiejun Zhao, Muyun Yang