AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 27

EF-LLM: A Continual Learning-Based Framework for AI-Assisted Automation, Enhanced Sparse Prediction, and Hallucination Detection

EF-LLM is a continual learning framework that combines domain knowledge, temporal data, and multimodal inputs to forecast energy demand and generation. It uses updatable Low‑Rank Adaptation and a multi‑channel architecture to continuously adapt to new data, improving accuracy especially under sparse‑data conditions. The model also uniquely detects and quantifies hallucinations through multi‑task learning and semantic similarity analysis.

By Zihang Qiu, Jayashri Ravishankar, Anam Malik, Zhongju Wang, Renyou Xie
arXiv AI
Oct 27

Robust and Fine-Grained Detection of AI Generated Texts

arXiv:2504.11952v4 Announce Type: replace-cross Abstract: An ideal detection system for machine generated content is supposed to work well on any generator as many more advanced LLMs come into existe...

By Ram Mohan Rao Kadiyala, Siddartha Pullakhandam, Kanwal Mehreen, Drishti Sharma, Siddhant Gupta, Jebish Purbey, Ashay Srivastava, Subhasya TippaReddy, Arvind Reddy Bobbili, Suraj Telugara Chandrashekhar, Ankan Ghosh, Modabbir Adeeb, Srinadh Vura, Suman Debnath, Hamza Farooq
arXiv AI
Oct 27

Health-SCORE: Towards Scalable Rubrics for Improving Health-LLMs

Health‑SCORE is a scalable rubric‑based framework designed to evaluate and train health‑focused large language models (LLMs). It reduces the need for extensive human expertise and development cost while maintaining evaluation quality comparable to human‑created rubrics. The framework also serves as a structured reward signal for reinforcement learning and can be embedded in prompts to enhance response quality via in‑context learning.

By Zhichao Yang, Sepehr Janghorbani, Dongxu Zhang, Jun Han, Qian Qian, Andrew Ressler II, Gregory D. Lyng, Sanjit Singh Batra, Robert E. Tillman
arXiv AI
Oct 27

Towards Real-world Human Behavior Simulation: Benchmarking Large Language Models on Long-horizon, Cross-scenario, Heterogeneous Behavior Traces

arXiv:2604.08362v3 Announce Type: replace-cross Abstract: The emergence of Large Language Models (LLMs) has illuminated the potential for a general-purpose user simulator. However, existing benchmark...

By Jiawei Chen, Ruoxi Xu, Boxi Cao, Ruotong Pan, Yunfei Zhang, Yifei Hu, Yong Du, Tingting Gao, Han Li, Yaojie Lu, Yingfei Sun, Xianpei Han, Le Sun, Xiangyu Wu, Hongyu Lin
arXiv Statistics ML
Oct 27

Isotonic Conformal Inference

arXiv:2607.16675v2 Announce Type: replace Abstract: A predictor with small overall bias can still exhibit systematic bias conditional on its predicted value, limiting its reliability for downstream u...

By Daniel Bensimon, Zhiquan Liu, Sean X. Yu, Eric D. Kolaczyk, Archer Y. Yang