arXiv Computation and Language September 1, 2026 By Hoejoon Kwon, Byeonggeuk Lim, Kahyeon Kim, YoungBin Kim

ALTSTEER: Selective Safety Steering for Moving Beyond Hard Refusals to Constructive Alternatives

Read the original on arXiv Computation and Language →

The Flow has not summarised this story yet — read it at arXiv Computation and Language.

arXiv Machine Learning

Jun 4

Expert-Aware Refusal Steering

arXiv:2606. 04160v1 Announce Type: cross Abstract: Safety alignment in instruction-tuned large language models (LLMs) depends on a model's ability to reliably refuse to respond to harmful or disallowed requests.

By Anna C. Marbut, Daniel R. Olson, Travis J. Wheeler

llms safety

arXiv Machine Learning

Jul 14

Safe responses matter: Output-aware safety guardrail mitigate over-refusal in MLLMs

arXiv:2607. 09697v1 Announce Type: new Abstract: Existing safety mechanisms for multimodal large language models (MLLMs) face a fundamental trade-off between safety and utility.

By Jiayi Li, Kun Zhan

llms fine-tuning multimodal safety

arXiv Machine Learning

Jul 14

Selective Safety Steering via Value-Filtered Decoding

arXiv:2605. 14746v2 Announce Type: replace Abstract: While large language models (LLMs) are trained to align with human values, their generations may still violate safety constraints.

By Bat-Sheva Einbinder, Hen Davidov, Yee Whye Teh, Yarin Gal, Yaniv Romano

llms safety

arXiv Machine Learning

Aug 11

Safety Cost of Steering Vectors Is Separable and Reducible

arXiv:2608. 08383v1 Announce Type: cross Abstract: Steering vectors are a lightweight tool for controlling LLM behavior.

By Yuxiao Li, Gjergji Kasneci

llms benchmarks safety

arXiv AI

Jun 6

From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents

arXiv:2606. 05805v1 Announce Type: new Abstract: LLM-based guardrails typically safeguard agents by evaluating proposed actions or inputs before execution, producing safety signals such as binary allow/deny decisions, risk categories, and/or explanatory rationales about potential policy violations.

By Yuhao Sun, Jiacheng Zhang, Shaanan Cohney, Zhexin Zhang, Feng Liu, Xingliang Yuan

llms agents safety

arXiv AI

Jul 7

Oyster-II: Reinforcement Learning for Constructive Safety Alignment in Large Language Models

arXiv:2607. 02914v1 Announce Type: new Abstract: Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, yet ensuring their simultaneous safety, helpfulness, and trustworthiness remains a persistent challenge.

By Jiyang Guan, Yong Xie, Jun Chen, Jiexi Liu, Zipeng Ye, Defeng Li, Jiayu Shen, Jialing Tao, Hui Xue

llms reinforcement-learning fine-tuning benchmarks safety

One email a morning, machine-written

Related stories

Expert-Aware Refusal Steering

Safe responses matter: Output-aware safety guardrail mitigate over-refusal in MLLMs

Selective Safety Steering via Value-Filtered Decoding

Safety Cost of Steering Vectors Is Separable and Reducible

From Risk Classification to Action Plan Remediation: A Guardrail Feedback Driven Framework for LLM Agents

Oyster-II: Reinforcement Learning for Constructive Safety Alignment in Large Language Models