AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 27

EpiPersona: Persona Projection and Episode Coupling for Pluralistic Preference Modeling

EpiPersona is a framework that explicitly couples persona and episode information to improve pluralistic preference modeling for large language models. It projects noisy preference feedback into a low‑dimensional persona space, aggregates similar personas into discrete codewords, and then couples the inferred persona representation with the current episode for episode‑aware preference prediction. Experiments demonstrate that EpiPersona outperforms baselines, especially in hard episodic‑shift scenarios and with sparse preference data.

By Yujie Zhang, Weikang Yuan, Zhuoren Jiang, Pengwei Yan
arXiv AI
Oct 27

Can Multi-modal (reasoning) LLMs work as deepfake detectors?

The paper investigates whether state‑of‑the‑art multi‑modal large language models (LLMs) can detect deepfake images. Twelve recent LLMs were benchmarked against traditional detectors on multiple datasets, including real‑world deepfakes, and prompt tuning was used to improve performance. Results show that the best LLMs can match or exceed conventional methods on out‑of‑distribution data, though many LLMs perform poorly; larger model size helps, but newer versions and reasoning abilities do not necessarily improve detection.

By Simiao Ren (Dennis), Yao Yao (Dennis), Kidus Zewde (Dennis), Zisheng Liang (Dennis), Tsang (Dennis), Ng (Dennis), Ning-Yau Cheng, Xiaoou Zhan, Qinzhe Liu, Yifei Chen, Hengwei Xu
arXiv AI
Oct 27

PCoreSet: Effective Active Learning through Knowledge Distillation from Vision-Language Models

The paper introduces ActiveKD, a framework that combines active learning with knowledge distillation by using large vision‑language models as teachers. It leverages the structured prediction bias of these models to design Probabilistic CoreSet (PCoreSet), a selection strategy that maximizes coverage in probability space rather than feature space. Experiments on 11 datasets show that ActiveKD improves all selection methods over a no‑distillation baseline, and PCoreSet consistently outperforms random sampling across multiple students and teachers.

By Seongjae Kang, Dong Bok Lee, Hyungjoon Jang, Dongseop Kim, Sung Ju Hwang
arXiv AI
Oct 27

Think Parallax: Solving Multi-Hop Problems via Multi-View Knowledge-Graph-Based Retrieval-Augmented Generation

The paper introduces ParallaxRAG, a multi-view retrieval-augmented generation framework that addresses multi-hop reasoning challenges in large language models over knowledge graphs. It identifies that transformer attention heads specialize in distinct semantic relations across reasoning stages, forming a hop-aligned relay pattern, and proposes decoupling queries and KGs into head-specific semantic spaces to enforce relational diversity. Experiments on WebQSP, CWQ, and BioASQ show state‑of‑the‑art performance, reduced hallucination, and strong generalization.

By Jinliang Liu, Jiale Bai, Shaoning Zeng
arXiv AI
Oct 27

A Causal Perspective on the Role of Training Dynamics for Interpreting Privacy Risks in Code Models

The paper investigates how different types of personally identifiable information (PII) are learned and leaked by large language models for code (LLM4Code). By creating a diverse PII dataset, fine‑tuning models of various scales, and analyzing training dynamics through a structural causal model, the authors find that leakage risk varies by PII type—easy‑to‑learn data such as IP addresses leak more often, while harder types like keys and passwords leak less. The study provides causal evidence that leakage risks are type‑dependent and suggests that defenses should be tailored to specific PII categories and their learnability.

By Hua Yang, Alejandro Velasco, Sen Fang, Bowen Xu, Denys Poshyvanyk
arXiv AI
Oct 27

DeALOG: Decentralized Multi-Agents Log-Mediated Reasoning Framework

DeALOG is a decentralized multi‑agent framework designed for multimodal question answering. It employs specialized agents—Table, Context, Visual, Summarizing, and Verification—that communicate via a shared natural‑language log, serving as persistent memory. This log‑based coordination enables collaborative error detection and verification without central control, leading to competitive performance on several benchmark datasets.

By Abhijit Chakraborty, Ashish Raj Shekhar, Shiven Agarwal, Vivek Gupta
arXiv AI
Oct 27

How well are open sourced AI-generated image detection models out-of-the-box: A comprehensive benchmark study

The study evaluates 16 AI‑generated image detection methods in a zero‑shot setting, testing 23 pretrained variants on 12 datasets with 2.6 million images from 291 generators. Results show no single detector consistently outperforms others, with accuracy ranging from 37.5 % to 75.0 %. The study highlights that training data alignment and generator type significantly affect performance, especially against modern commercial models, and identifies systematic failure patterns across datasets.

By Simiao Ren (Neo), Yuchen Zhou (Neo), Xingyu Shen (Neo), Kidus Zewde (Neo), Tommy Duong (Neo), George Huang (Neo), Hatsanai (Neo), Tiangratanakul (Dennis), Tsang (Dennis), Ng (Dennis), En Wei, Jiayu Xue
arXiv AI
Oct 27

Multi-Agentic AI for Fairness-Aware and Accelerated Multi-modal Large Model Inference in Real-world Mobile Edge Networks

The paper proposes a Multi-Agentic AI framework to enable fairness‑aware and accelerated inference of large, heterogeneous multi‑modal language models on mobile edge networks. It introduces a Global Planning Agent, a Prompt Scheduling Agent, and multiple on‑node LM Deployment Agents that jointly optimize prompt routing and model deployment using natural language reasoning over telemetry and historical data. Experiments on a city‑wide testbed show a 42.9% reduction in end‑to‑end latency versus a state‑of‑the‑art baseline and an 80.6% reduction versus a full‑activation baseline, while preserving high fairness (Jain's index 0.925).

By Haiyuan Li, Hari Madhukumar, Shuangyi Yan, Yulei Wu, Dimitra Simeonidou
arXiv AI
Oct 27

EntailLLM: Verifying Agent-Generated Vulnerability Discovery Paths with Domain Knowledge via Logic Programming

EntailLLM is a framework that verifies vulnerability discovery paths generated by large language model agents using a separate knowledge graph and logic programming. The system checks whether the agent’s traversal of a function call graph is entailed by domain knowledge, improving pooled entailment from 77% to 98% across various binaries and CWE classes. It is deployed on real medical-device binaries, achieving high entailment without per-device tuning and offering logical, explainable verification grounded in formal semantics.

By Kaustuv Mukherji, Jaikrishna Manojkumar Patil, Colton Payne, Paulo Shakarian, Dana Warmsley, Nigel Stepp, Evelyn Kim
arXiv Machine Learning
Oct 27

Input Bias Correction in Gaussian Process Regression

arXiv:2610.31920v1 Announce Type: cross Abstract: In traditional Gaussian process (GP) regression, the inputs are typically assumed to be known, and uncertainty enters only through the measurements....

By Muzaffar Qureshi, Tochukwu E. Ogri, Trivikram Satharasi, Kyle Volle, Rushikesh Kamalapurkar