arXiv AI
Jun 15

Fractured Chain-of-Thought Reasoning

arXiv:2505. 12992v4 Announce Type: replace-cross Abstract: Inference-time scaling techniques have significantly bolstered the reasoning capabilities of large language models (LLMs) by harnessing additional computational effort at inference without retraining.

By Baohao Liao, Hanze Dong, Yuhui Xu, Doyen Sahoo, Christof Monz, Junnan Li, Caiming Xiong
arXiv AI
Oct 9

Thought-Like-Pro: Enhancing Reasoning of Large Language Models through Self-Bootstrapped Prolog-based Chain-of-Thought

Thought‑Like‑Pro is a learning framework that enhances large language models’ reasoning by combining imitation learning with a Prolog logic engine. The approach imitates chain‑of‑thought processes verified by symbolic reasoning, allowing models to formulate rules from instructions and convert Prolog‑derived reasoning trajectories into natural language. Experiments show significant reasoning improvements and robust generalization with only a marginal performance drop on distributional extrapolation tasks.

By Xihe Qiu (Shanghai University of Engineering Science, National University of Singapore), Yongxin Deng (Shanghai University of Engineering Science, University of Technology Sydney), Xiaoyu Tan (National University of Singapore), Zhen Fang (University of Technology Sydney), Ling Chen (University of Technology Sydney)