AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 15

Reinforcement Learning In Partially Verifiable Environments for Colon Cancer Treatment Planning

arXiv:2610.17426v1 Announce Type: cross Abstract: Clinical decision-making is a sequential process of information collection, clinical inference, and forecasting under partial observability, often wi...

By Li-Ching Chen, Andr\'es Franco Valiente, Yuta Ishiyama, Zachary R. Chalmers, William Chen, Kelsey Natsuhara, Taema Brinjikji, Madhumita Sushil, Travis Zack, Julian C. Hong
arXiv Statistics ML
Oct 15

MCMC Can See Can't See

arXiv:2610.20020v1 Announce Type: cross Abstract: It is folklore that passing "convergence" diagnostics does not guarantee that a Markov chain has converged. We prove this as an impossibility for any...

By Daniel Matsui Smola
arXiv AI
Oct 15

Acceptable Misalignment

arXiv:2610.16881v1 Announce Type: new Abstract: There is a specific challenge designers face in developing autonomous robots capable of open-ended learning. This challenge is how one can develop such...

By Maud van Lier, Ludovica Marinucci, Vieri Giuliano Santucci, Raja Chatila, St\'ephane Doncieux, \'Emiland Garrab\'e, Richard Duro