AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,884 stories · RSS feed

Towards Data Science
Aug 25

Hallucinations, Watermarks, Removers, and a Squeezed Balloon

The article discusses how watermarks function during moments of uncertainty in AI models, paralleling safety checks that identify mistakes. It examines the roles of hallucinations, watermarks, and removal techniques in ensuring model reliability. The piece also touches on the metaphor of a squeezed balloon to illustrate constraints on model output.

By Javier Marín Valenzuela
arXiv AI
Aug 25

Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundations

arXiv:2507.04356v3 Announce Type: replace-cross Abstract: Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This...

By Vyacheslav Kungurtsev, Alessandro Di Frenna, Gustav Sir, Monicah Cherop Naibei, Haozhe Tian, Homayoun Hamedmoghadam, Akhil Anand, Sebastien Gros