AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,798 stories · RSS feed

arXiv AI
Sep 24

AI-Driven Neural Surrogates for In Silico Design of Cognitive-Affective Neuromodulation Targets

arXiv:2609.27729v1 Announce Type: cross Abstract: In neuropsychiatry, the primary goal is often not only to decode brain activity but to change it, for example to lessen a negative affective bias or...

By Marco Rothermel, Madleen Stenger, Soroush Daftarian, Svenja Jule Francke, Bita Shariatpanahi, Jos\'e C. Garc\'ia Alanis, Mohammad-Ali Nikouei Mahani, Stefan G. Hofmann, Tim Hahn, Hamidreza Jamalabadi
arXiv Computer Vision
Sep 24

A comparative assessment of global building and settlement datasets across geographic and settlement contexts

arXiv:2609.28154v1 Announce Type: new Abstract: Global building and settlement datasets increasingly support population mapping, exposure assessment, urban monitoring, and other analyses of the built...

By Rufai Omowunmi Balogun, Caroline Margaux Gevaert, Capucine Riom, Derrick Mirindi, Aaron Opdyke, Hamed Alemohammad, Pierre Chrzanowski, Edward Charles Anderson
arXiv AI
Sep 24

FSCE: A Target-Aware Frequency-Spatial Collaborative Enhancement Framework for Noise-Resilient SAR ATR

The paper introduces FSCE, a Target‑Aware Frequency‑Spatial Collaborative Enhancement framework designed to improve noise‑resilient synthetic aperture radar (SAR) automatic target recognition (ATR). It combines a Frequency‑Spatial Early‑stage Adaptive Enhancement module that suppresses speckle noise while preserving target structures, with an Adaptive Policy‑driven Semantic Alignment mechanism that applies top‑down semantic constraints during training. Experiments on MSTAR, OpenSARShip, and FUSARShip datasets show that the lightweight FSCE‑Net_µ, with only 0.17 M parameters, achieves competitive performance across both high‑capacity and lightweight architectures.

By Yansong Lin, Zihan Cheng, Ziyue Yang, Xinming Wang, Jielei Wang, Guoming Lu, Zongyong Cui
arXiv AI
Sep 24

Beyond Unsafe Detection: Counterfactually Anchored Evidence Attribution for Multi-Turn LLM Safety Failures

The paper introduces a counterfactually anchored evidence attribution approach for multi‑turn large language model safety failures. It presents a new dataset of 1,762 conversations, including adversarial, benign twins, and high‑risk vocabulary variants, and trains a lightweight hierarchical model that accurately predicts safety violations and attributes them to specific user turns and token spans. The model achieves high detection performance (F1 = 0.988) and significantly reduces adversarial confidence when top‑attributed tokens are removed, while maintaining low false‑positive rates on benign conversations.

By Srinivasan Subramanian, Kazi Aminul Islam, Md. Abdullah Al Hafiz Khan
arXiv AI
Sep 24

Algorithmic Unverifiability of Safety for Fixed and Recursively Self-Improving Systems

The paper proves that algorithmic safety verification for Turing‑complete, self‑modifying systems—whether fixed or recursively self‑improving—is fundamentally limited. Statistically, no verifier can be sound, complete, and tractable across unbounded domains, all finite configurations, or succinctly described finite environments, due to Rice’s, Gödel’s, Trakhtenbrot’s, coNP, and PSPACE barriers. Dynamically, even a single self‑modification step can render safety properties undecidable, and no total supervisory algorithm can guarantee correctness for all such transformations, though a monitor that raises alarms on violations remains feasible. whyItMatters":"The results show that formal safety guarantees for recursive self‑improvement are unattainable, highlighting intrinsic verification barriers for advanced AI systems."

By Jose Pascual Gumbau Mezquita