arXiv AI
Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
Read the original on arXiv AI →The Flow has not summarised this story yet — read it at arXiv AI.
Related stories
arXiv AI
Jul 2
Reasoning Up the Instruction Ladder for Controllable Language Models
arXiv:2511. 04694v5 Announce Type: replace-cross Abstract: As large language model (LLM) based systems take on high-stakes roles in real-world decision-making, they must reconcile competing instructions from multiple sources within a single prompt context.
arXiv AI
Oct 19
Reasoning Models Can Control Their Chains of Thought When They Tell Themselves To
The paper investigates chain-of-thought (CoT) controllability in reasoning models, noting that traditional evaluations show low controllability when constraints are given in user prompts. It introduces Self‑Instructed CoT Controllability, where constraints are embedded as self‑instructions within the model’s CoT, leading to markedly higher controllability. The study also shows that simple self‑instruction prompts can bootstrap effective control and that this capability can be exploited for monitor evasion, raising concerns about CoT monitorability.
arXiv AI
Jun 9
Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models
arXiv:2606. 07808v1 Announce Type: new Abstract: Reasoning language models deployed in agentic workflows must follow an instruction hierarchy: when instructions from different sources conflict, the model should obey the highest-privilege applicable instruction.
arXiv Machine Learning
Jun 5
Reasoning Models Don't Just Think Longer, They Move Differently
arXiv:2605. 15454v2 Announce Type: replace-cross Abstract: Reasoning-trained language models often spend more tokens on harder problems, but longer chains of thought do not show whether a model is merely computing for more steps or following a different internal trajectory.
arXiv AI
Jul 24
Post-Hoc Reasoning in Chain of Thought: Decoding and Steering Pre-Committed Answers
arXiv:2603. 01437v2 Announce Type: replace Abstract: As chain of thought (CoT) has become central to scaling reasoning capabilities in large language models (LLMs), it has also emerged as a promising tool for interpretability, suggesting the opportunity to understand model decisions through verbalized reasoning.
arXiv AI
Aug 18
Rethinking Generalization in Reasoning SFT: A Conditional Analysis on Optimization, Data, and Model Capability
arXiv:2604. 06628v2 Announce Type: replace Abstract: A prevailing narrative in LLM post-training holds that supervised finetuning (SFT) memorizes while reinforcement learning (RL) generalizes.