arXiv Machine Learning

The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness

The paper titled "The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness" argues that advances in logical reasoning for large language models (LLMs) are likely to lead to increased situational awareness, a dangerous emergent capability. It introduces the RAISE framework, outlining three mechanistic pathways—deductive self inference, inductive context recognition, and abductive self modeling—through which logical reasoning can deepen an AI’s self‑awareness. The authors map current LLM reasoning research onto these pathways, show that existing safety measures are inadequate, and propose safeguards such as a Mirror Test benchmark and a Reasoning Safety Parity Principle.

arXiv AI
Aug 28

Do Language Models Follow Occam's Razor? An Evaluation of Parsimony in Inductive and Abductive Reasoning

The paper investigates whether large language models (LLMs) follow Occam's Razor when performing inductive and abductive reasoning. It introduces a synthetic framework for generating questions that require both types of reasoning and a new automated metric to evaluate the simplicity and correctness of generated hypotheses. Experiments show that while LLMs can handle simple scenarios, they struggle with complex world models and producing high‑quality, simplest hypotheses, even when using advanced reasoning techniques.

By Yunxin Sun, Abulhair Saparov
arXiv Computation and Language
5d ago

Safin-1.5: Safety-Native Architecture and Verifiable Reasoning for Recursive Safety Improvement

Safin-1.5 is a large language model that incorporates a safety‑native architecture and a recursive safety improvement loop to enhance its own safety while maintaining utility. The architecture uses persistent safety states and hazardous‑knowledge disentanglement to isolate and remove risky knowledge with minimal impact on general capabilities. An inference‑time harness extends the model’s abilities to formal reasoning by combining language understanding with symbolic inference and verification, enabling the construction of checkable proofs.

By Jingnan Zheng, Cheng Jin, Ming Zhang, Huan Sun, Zhongtian Ma, Kaisen Yang, Ziyuan Zhou, Tong Wu, Dongcheng Zhang, Yi Zhang, Xiao Wang, Han Qi, Shu Yu, Ermo Hua, Zongji Yu, Chaozhuo Li, Xiaoyu Wen, Zhekai Chen, Jiawei Zhou, Sirui Chen, Ning Ding, An Zhang, Tat-Seng Chua, Xiangnan He, Xia Hu, Bowen Zhou, Qiaosheng Zhang, Youbang Sun, Xiang Wang, Zhongyu Huang, Chaochao Lu
arXiv Machine Learning
Sep 11

Negative Self-Distillation: Learning to Reason by Avoiding Flaws

Negative Self-Distillation (NSD) is a new framework for improving large language models by encouraging them to diverge from their own flawed reasoning rather than imitate privileged solutions. Unlike On-Policy Self-Distillation, which can suppress uncertainty and exploratory behavior, NSD generates a question‑specific negative condition (e.g., a careless reasoner) and uses a dynamic gating mechanism to target only reasoning‑critical tokens for penalization. This approach preserves foundational language capabilities while consistently outperforming OPSD and other label‑free self‑bootstrapping reinforcement learning baselines.

By Rongcan Pei, Zhepei Wei, Shuyao Xu, Xinyu Zhu, Wei-Lin Chen, Yu Meng
arXiv AI
Oct 16

StepSafe: Learning Timely Intervention with Context-Aware Safety Reasoning

StepSafe introduces a training framework called ASPO that focuses on step‑level timely intervention in agentic systems. It aligns decisions with their respective prefixes, rewards actions that fit the current stage, and uses adaptive feedback self‑distillation to credit reasoning. The resulting StepSafe guardrail achieves state‑of‑the‑art performance on five agent‑safety benchmarks, improving the safety‑utility Pareto curve with a Youden’s J of 53.0 for a 4B model.

By Siyi Gu, Kunhan Gao, Chao Peter Yang, Sukanta Ganguly, Rex Ying, Arman Cohan
arXiv AI
Sep 15

Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models

The paper investigates how large language models perform propositional logical reasoning by conducting a causal mechanistic analysis on the PropLogic-MI benchmark. It identifies four interlocking mechanisms—Staged Computation, Information Transmission, Fact Retrospection, and Specialized Attention Heads—that organize the reasoning process across layers. The study demonstrates that these mechanisms recur across different model families, rule categories, and reasoning hops, indicating a structured, layer‑organized internal process for propositional reasoning.

By Danchun Chen, Qiyao Yan, Chenpeng Wang, Liangming Pan
arXiv AI
Jul 21

A Dual-Hypothesis Reasoning Framework for LLM Guardrails

arXiv:2607. 17575v1 Announce Type: new Abstract: We propose ARBITER, a novel LLM guardrail framework that introduces two key ideas: (i) dual-hypothesis reasoning, a reasoning method for LLM guardrails that explicitly considers both safe and unsafe interpretations of a prompt before making a safety decision, and (ii) multi-component supervised fine-tuning (MC-SFT), a structured training loss for reasoning-based guardrails that decomposes LLM outputs into logical components and weights them according to their importance.

By Md Asiful Islam, Mihai Surdeanu