AI safety and alignment

Alignment, interpretability, red-teaming, bias and privacy: the research on what these systems do when they misbehave.

17,788 stories · RSS feed

arXiv AI
Oct 27

Steering the Teacher: Improving On-Policy Self-Distillation for Thinking Models

The paper introduces Steered-Teacher OPSD (ST-OPSD), a method that improves on-policy self-distillation for thinking models by steering the teacher’s hidden states to reduce reference hallucinations and encourage reconsideration. ST-OPSD extracts two directions from reasoning trajectories and applies them during distillation target computation, allowing the student to learn from a teacher that no longer invokes unavailable references and that promotes verification at uncertain steps. Experiments on AIME and HMMT demonstrate that ST-OPSD outperforms vanilla OPSD and other interventions, restoring reconsideration and reference-hallucination rates to base-model levels.

By Tiejin Chen, Xiaoou Liu, Hanyang Chen, Hua Wei
arXiv AI
Oct 27

Single-Cycle Battery Remaining Useful Life Prediction with Compressed Continuous Wavelet Features and Deep Neural Networks

The paper presents a method for predicting the remaining useful life of lithium‑ion batteries using only the first few charge‑discharge cycles. It transforms voltage, current, and capacity data into time‑frequency representations via continuous wavelet transform, compresses the resulting scalograms to reduce redundancy, and feeds them into deep neural networks. Experiments on eight benchmark datasets show the approach outperforms previous methods across diverse chemistries and cycling protocols, and visual explanations confirm the model focuses on meaningful time‑frequency regions.

By Sungeun Kim, Mingyu Jung, Yuri Kim, Jin-Sung Park, Jongbin Ryu
arXiv AI
Oct 27

UMAS: System-Level Uncertainty Quantification for Multi-Agent LLM Systems

UMAS is a parameter‑free, cost‑neutral framework for system‑level uncertainty quantification in multi‑agent large language model systems. It estimates the credibility of inter‑agent influence using each generation’s intrinsic confidence, modulates uncertainty updates at each node, and aggregates these into a system‑level estimate. Evaluations on Debate and DyLAN show UMAS outperforms state‑of‑the‑art baselines by an average of 10.54 AUROC points and improves hallucination detection and answer selection, boosting MAS accuracy by up to 12.6 points on specific tasks.

By Hanwen Li, Jinhao Duan, Xiaoshuang Shi, Yue Zhang, Tianlong Chen, Kaidi Xu, Chenxi Yuan
arXiv AI
Oct 27

T2D: Target-to-Draft Model Pruning & Adaptation for Efficient Speculative Decoding

The paper introduces T2D, a framework that prunes and adapts a target large language model into a draft model optimized for both inference latency and alignment with the target model’s outputs. By formulating draft model design as an optimization problem, T2D achieves up to 92% pruning while maintaining high speculative decoding performance across multiple target model families and domains. The resulting draft models can also be integrated with other speculative decoding techniques to yield additional gains.

By Shahriar Kabir Nahin, Xiao Ye, Muhao Chen, Ben Zhou, Anshuman Chhabra