AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv Computation and Language
Oct 19

MAS-Bai: Linguistically Informed Adaptive Multi-Agent Translation for Bowen-Script Bai

arXiv:2610.23205v1 Announce Type: new Abstract: Large Language Models (LLMs) remain unreliable for extremely low-resource languages whose writing systems conflict with high-resource pretraining prior...

By Jingting Zheng (TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China), Hong Ren (TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China), Yuehan Cui (TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China), Shaolin Zhu (TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China), Deyi Xiong (TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China)
arXiv AI
Oct 16

In the Guise of Correction: How Framing and Cultural Adaptation Erode LLM Safety on Real-World Criminal Cases

The paper introduces GUISE, a benchmark of criminal‑assistance scenarios drawn from real‑world cases and organized using the UNODC International Classification of Crime for Statistical Purposes. It evaluates large language models under three linguistic framings and across five cultures, finding that framing and cultural adaptation significantly increase unsafe compliance rates. The study also shows that unsafe responses from the least‑safe models exhibit strong Anglocentric language, with leakage growing alongside harmfulness.

By Mohsinul Kabir, Md. Tariquzzaman, Karam S. R. Elradie, Polydoros Giannouris, Yuechen Jiang, Shaoxiong Ji, Sophia Ananiadou
arXiv AI
Oct 16

GeoState: Learning View-Decoupled Geometry States for 3D World Modeling

GeoState introduces a view‑decoupled geometry representation for predictive 3D world modeling, separating scene‑state evolution from camera‑dependent observation. It aggregates multi‑view geometry foundation model features into a scene tokenizer, then uses a geometry decoder to query this state with camera rays. An autoregressive world model predicts future scene states while modeling camera motion independently, enabling consistent decoding under any camera and maintaining a single context‑derived scale throughout rollouts.

By Hongchang Liu, Jian Liu, Yujuan Ding, Liang Peng, Xun Jiang, Fei Ma, Xing Xu, Yi Bin
arXiv Machine Learning
Oct 16

PocketTSLM: Deploying an On-Device Soft-Prompt Time-Series Language Model for Privacy-Preserving Smartphone Reasoning

PocketTSLM is a mobile-native deployment of the OpenTSLM SoftPrompt time‑series language model that runs entirely on a consumer smartphone. By injecting encoded time‑series windows as embeddings instead of tokenizing them as text, PocketTSLM preserves temporal structure while using far fewer tokens and staying within the device’s context and memory limits. The model has been benchmarked on 30‑second EEG sleep‑staging clips and 10‑second ECG recordings, achieving on‑device inference with no health data transmitted to the cloud.

By Max Rosenblattl, Nikhil Krishnaswamy, Leon Nissen, Manuel Milling, Nicolas Zumarraga, Ning Wang, Thomas Kaar, Robert Jakob, Bj\"orn W. Schuller, Elgar Fleisch, Patrick Langer, Paul Schmiedmayer
arXiv Machine Learning
Oct 16

Market Incentives for AI Safety Investment

The paper examines how profit motives influence safety investment in AI, focusing on a supply chain with an upstream large language model (LLM) provider and multiple downstream firms. Using a game‑theoretic model, it shows that downstream competition tends to drive firms to invest more in safety than would maximize industry profit, while the upstream provider may underinvest because it does not capture all the benefits of safer models. The study also explores how regulatory interventions could shift incentives and affect overall model safety.

By Nikita Tsoy