arXiv Machine Learning

Think Harder Where It Matters: Item-Level Adaptive Recursion for Sequential Recommendation

The paper introduces LoopRec, an item‑level adaptive recursion mechanism for sequential recommendation that replaces the conventional fixed‑depth computation with a learned, per‑item depth assignment. LoopRec recursively applies a shared block and uses a lightweight gate to decide whether each item should exit or continue processing, allowing early exit for items that converge quickly while allocating deeper computation to critical items. Experiments on multiple backbone families show that LoopRec consistently outperforms fixed‑depth counterparts, with learned depth patterns aligning with lower‑frequency and more recent items.

arXiv Machine Learning
Jul 14

RecRec: Recursive Refinement for Sequential Recommendation

arXiv:2607. 10541v1 Announce Type: cross Abstract: Sequential recommender systems typically infer user preferences through single-pass encoding of interaction histories without iterative refinement, relying on increasingly deep architectures to capture complex patterns.

By Pervez Shaik, Prosenjit Biswas, Abhinav Thorat, Ravi Kolla, Niranjan Pedanekar
arXiv AI
Sep 25

DeGRe: Dense-supervised Generative Reranking for Recommendation

DeGRe is a dense‑supervised generative reranking framework designed to improve multi‑stage recommender systems by addressing label bias and credit assignment issues. It uses an offline Lookahead Evaluator with beam search to generate dense supervision signals, which are distilled into a lightweight Online Generator that can perform efficient greedy decoding at inference time. Experiments show that DeGRe outperforms baselines on public benchmarks and industrial datasets, and it has been successfully deployed on Taobao Flash Shopping to enhance online recommendations.

By Chaotian Song, Jingyao Zhang, Chenghao Chen, Zisen Sang, Dehai Zhao, Guodong Cao, Boxi Wu, Deng Cai, Jia Jia
arXiv Computation and Language
Oct 9

Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation

The paper introduces MARI, a Memory-Augmented Recommendation system that uses a Decision Memory Bank to store Structured Decision Memories (SDMs) capturing users’ goals, constraints, and trade-offs. Unlike prior methods that flatten heterogeneous behaviors into token sequences, MARI retrieves relevant SDMs to enhance LLM reasoning, improving performance on next-item prediction and a new Difficult Choice Prediction task while keeping latency low. The approach also provides interpretable, human-readable insights into user decision-making.

By Leikun Liang, Guoshuai Wang, Xingsheng He, Yushan Han, Yunyi Xuan, Xiaoxiao Xu, Lin Qu
arXiv AI
Aug 20

rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation

The paper introduces rEDMRec, a method that compresses a large language model’s reasoning about user preferences and item comparisons into a compact, editable memory. This memory, organized into four channels—long‑term preference, short‑term context, item perception, and counterfactual hard‑negative comparisons—can be updated by an LLM controller and queried by a lightweight student LLM for ranking, eliminating the need to re‑run the expensive teacher model for each request. Experiments on ML‑1M, Amazon Beauty, and Steam datasets show that rEDMRec consistently outperforms zero‑shot, few‑shot, RAG, and GraphRAG baselines, achieving up to a 13.3% improvement in HR@1 on ML‑1M.

By Minh Hoang Nguyen, Tung Le, Huy Tien Nguyen
arXiv AI
Sep 10

SequenceO1: End-to-End Ultra-Long (100K) Sequence Modeling in Recommendation with Low-Rank Caching

SequenceO1 is an end‑to‑end framework that enables ultra‑long (up to 100K interactions) sequence modeling for recommendation systems. It compresses raw user histories into a fixed‑size sketch using Sketch Attention and then models short‑term and long‑term interests with Target‑to‑History Cross Attention. The system incorporates low‑rank caching, batching, pipeline lift, and a FlashSA kernel to keep training and inference efficient, achieving consistent offline and online performance gains when deployed at full traffic on Douyin.

By Lin Guan, Jia-Qi Yang, Zhishan Zhao, Jiaqi Huang, Hangyu Wang, Longbin Li, Beichuan Zhang, Haonan Jiang, Jinan Ni, Xiangyu Fan, Xiaowen Li, Ziyao Ren, Yuhang Qi, Xiaolong Zhu, Xuanyuan Luo, Qiwei Chen, Yi Cheng, Lele Yu