arXiv AI

Diagnosing Pathological Chain-of-Thought in Reasoning Models

arXiv:2602. 13904v2 Announce Type: replace Abstract: Chain-of-thought (CoT) reasoning is fundamental to modern LLM architectures and represents a critical intervention point for AI safety.

arXiv AI
3d ago

Making LLMs Say What They Think: Measuring and Improving CoT-Interpretability Alignment

The paper introduces CoT-Interpretability Alignment (CIA), a metric that quantifies how well a large language model’s chain-of-thought (CoT) explanations match its internal reasoning processes. Evaluated on two-hop question answering, hint intervention, and integer multiplication across three LLMs, the study finds limited alignment (44.8–75.9%) and demonstrates that post‑training with a reward combining task accuracy and parametric faithfulness can substantially improve CoT faithfulness without sacrificing accuracy. The authors provide a framework for auditing CoT faithfulness and a pathway to making explicit reasoning more trustworthy, with code and data publicly available.

By Yihuai Hong, Shauli Ravfogel, Chen Zhao, Eunsol Choi
arXiv AI
Jun 26

Where Do CoT Training Gains Land in LLM based Agents?

arXiv:2606. 26935v1 Announce Type: new Abstract: Chain-of-thought (CoT) reasoning is widely used in language-model agents, but prior work has shown that verbalized CoT is not always faithful and may instead reflect post-hoc reasoning, which means the model already knows the answer before reasoning.

By Jingyu Liu, Zhiwen Wang, Yuxin Jing, Huanyu Zhou, Yong Liu