AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv Machine Learning
1d ago

Alignment Myopia in Generative AI

arXiv:2611.06830v1 Announce Type: cross Abstract: Current generative AI alignment relies on a myopic paradigm that prioritizes immediate conversational satisfaction. By relying on short-horizon feedb...

By Remi Denton, Aida Davani, Cynthia L Bennett, Michael Madaio, Roma Patel, Himabindu Lakkaraju
arXiv Machine Learning
1d ago

Federated Concept-Based Models: Interpretable models with distributed supervision

arXiv:2602.04093v3 Announce Type: replace Abstract: Concept-based Models (CMs) enhance interpretability in deep learning by grounding predictions in human-understandable concepts. However, concept an...

By Dario Fenoglio, Arianna Casanova, Francesco De Santis, Gabriele Dominici, Johannes Schneider, Pietro Barbiero, Giovanni De Felice, Marc Langheinrich, Martin Gjoreski
arXiv Machine Learning
1d ago

Benchmarking Sensor-Fault Robustness in Forecasting

arXiv:2605.10822v2 Announce Type: replace Abstract: Cyber-physical system (CPS) forecasting models depend on sensor streams with noisy, biased, missing, or temporally misaligned readings, yet standar...

By Alexander Windmann, Philipp Wittenberg, Gianluca Manca, Marcel Dix, Jens U. Brandt, Oliver Niggemann