arXiv Computation and Language
22h ago

Do Recommenders Need to Think in Words? Latent Reasoning for Efficient LLM-Based Recommendation

The paper introduces LatentRec, a framework that replaces inference-time chain-of-thought reasoning in large language model (LLM) recommender systems with training-time per-step supervision. It employs a 2.5 M-parameter Continuous Thought Module, Soft Token Selection, and a Per-step Reasoning Loss to guide intermediate hidden states toward the target semantic ID. After training, the module can be removed, yielding a 4–5 % relative improvement in HR@10 on Amazon benchmarks while reducing inference latency by 18.3×.

By Hongyang Su, Beibei Kong, Lei Cheng, Chengxiang Zhuo, Zang Li
arXiv AI
Jul 31

WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Models

arXiv:2607. 26621v2 Announce Type: cross Abstract: Large language models (LLMs) have demonstrated strong reasoning capabilities, motivating their adoption as backbones for foundation recommendation models (FRMs).

By Hao Jiang, Peiru Du, Pengfei Yao, Mengting Li, Siyuan Lou, Kuo Cai, Sheng Yu, Qiang Luo, Jian Liang, Ruiming Tang, Fei Pan, Peng Jiang, Wenwu Ou