arXiv AI

SKIP: a Self-knowledge-guided Step-wise Preference Learning Framework for Concise Reasoning

Hugging Face Trending Papers
Aug 11

Towards Efficient Reasoning in LLM-Based Recommender Systems via Model Merging

Large language model-based recommender systems are increasingly adopting slow-thinking models that generate step-by-step reasoning before making predictions, often achieving higher accuracy than fast-thinking models that predict directly. However, their reasoning traces are often unnecessarily verbose, increasing inference costs without commensurate accuracy gains.

arXiv Computation and Language
Aug 27

GRIP: Granular Reward-Guided Parameter Interpolation for Efficient Reasoning

GRIP (Granular Reward-guided Interpolation of Parameters) is a lightweight framework that blends a reasoning-oriented large language model with an instruction-tuned model by assigning learnable interpolation ratios to individual modules. The ratios are optimized while keeping both source models frozen, using a reward signal that prefers correct and concise responses. Experiments demonstrate that GRIP improves the accuracy-efficiency trade-off compared to fixed or search-based merging baselines and uncover module-wise fusion patterns linked to efficient reasoning.

By Lam So, Canhui Wu, Han Lin
arXiv AI
Sep 7

Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models

The paper surveys efficient reasoning in large language models, contrasting fast intuitive (System 1) and slow deep (System 2) reasoning. It analyzes why System 2 is computationally costly yet more accurate, and why System 1 is efficient but less effective. The survey covers causes of inefficiency, patterns of reasoning behavior, and potential solutions to balance performance and computational budgets, offering actionable insights and an open‑source repository for ongoing research.

By Rui Wang, Hongru Wang, Boyang Xue, Jianhui Pang, Shudong Liu, Yi Chen, Jiahao Qiu, Derek Fai Wong, Heng Ji, Kam-Fai Wong