AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 26

Deep Learning Warm Starts for Trajectory Optimization on the International Space Station

The paper reports the first in‑space demonstration of using machine learning‑based warm starts to accelerate trajectory optimization for the Astrobee free‑flying robot on the International Space Station. A neural network is trained to learn the structure of the trajectory generation problem solved by sequential convex programming, and onboard predictions reduce solver iterations by 60% for rotational dynamics and 50% for obstacle‑laden scenarios. This approach enables real‑time trajectory planning while respecting safety constraints on limited flight hardware.

By Somrita Banerjee, Abhishek Cauligi, Marco Pavone
arXiv Computation and Language
Oct 26

Aligning Large Language Models with Human Feedback: Mathematical Foundations and Algorithm Design

arXiv:2610.31862v1 Announce Type: cross Abstract: This article provides an introduction to the mathematical foundations and algorithmic frameworks used to align Large Language Models (LLMs) with huma...

By Siliang Zeng, Luca Viano, Chenliang Li, Jiaxiang Li, Volkan Cevher, Markus Wulfmeier, Stefano Ermon, Alfredo Garcia, Mingyi Hong
arXiv Computation and Language
Oct 26

AfriGuard: Safety and Robust Refusal For African Languages

arXiv:2610.26474v2 Announce Type: replace Abstract: Large language models (LLMs) designed to interact with users are typically trained to respond appropriately to harmful or toxic content. However, e...

By Israel Abebe Azime, Jesujoba O. Alabi, Iffat Maab, Alexander D. Cai, Tadesse Destaw Belay, Atnafu Lambebo Tonja, Jonas Kgomo, Folasade Alabi, Salomey Osei, Saminu Muhammad Aliyu, Nkechinyere Faith Aguobi, Bontu Fufa Balcha, Blessing Sibanda, Davis David, Mouhamadane Mboup, Daud Abolade, Neo Putini, Louis Powell, Kiant'e Brantley, Philipp Slusallek, Dietrich Klakow, Julia Kreutzer