The paper investigates chain-of-thought (CoT) controllability in reasoning models, noting that traditional evaluations show low controllability when constraints are given in user prompts. It introduces Self‑Instructed CoT Controllability, where constraints are embedded as self‑instructions within the model’s CoT, leading to markedly higher controllability. The study also shows that simple self‑instruction prompts can bootstrap effective control and that this capability can be exploited for monitor evasion, raising concerns about CoT monitorability.
By Uriel Dolev, Idan Schwartz, Yoav Goldberg
arXiv:2603.18614v2 Announce Type: replace
Abstract: Tool-augmented large language models (LLMs) must tightly couple multi-step reasoning with external actions, yet existing benchmarks often confound...
By Wanjia Zhao, Ludwig Schmidt, Yejin Choi, James Zou, Vidhisha Balachandran, Lingjiao Chen
CritICL is an inference-time framework that enhances reasoning in large language models by using failure patterns from weaker models as critique-based in-context examples. It offers two variants: CritICL-dynamic, which predicts input-specific failure modes, and CritICL-static, which applies a global failure mode profile. Experiments show that CritICL outperforms standard in-context learning and rivals test-time scaling methods while using fewer generations and lower token costs.
By Yufan Wu, Yinghui He, Zhengyi Hu, Lang Wei, Ruichen Li, Qifan Yang, Ting Zhu
arXiv:2607. 18100v1 Announce Type: new Abstract: Extended reasoning has become standard for frontier Large Language Models (LLMs), yet the trajectories these models produce remain largely uncontrollable.
By Sheldon Yu, Tong Yu, Xunyi Jiang, Rohan Surana, Gagan Mundada, Sungchul Kim, Lina Yao, Julian McAuley, Junda Wu
arXiv:2608.29988v1 Announce Type: new
Abstract: Large language models (LLMs) achieve strong reasoning performance, which depends critically on inference-time decisions. Yet these decisions are common...
By Hanjun Luo, Qiushi Liu, Jingya Zhang, Haihong Pang, Jiaheng Wen, Yifei Ma, Yu Yao, Chengxi Zhang, Hanrong Zhang, Yankai Chen, Hanan Salam
The paper introduces a hierarchical feedback framework that guides large language models (LLMs) to produce executable plans for cyber‑physical systems (CPSs) from natural language commands. It prompts LLMs to generate both a structured task plan and signal temporal logic (STL) constraints, then uses a sound algorithm to detect contradictions and provide feedback for plan revision. At execution time, diagnostic information from failed control synthesis—such as violated constraints and conflicting component assignments—is fed back to the LLM to enable task replanning, achieving an 87.9% success rate on seven heterogeneous CPS scenarios.
By Jinglin Dai, Jiawan Wang, Ruiqi Hong, Lei Bu