arXiv AI

Conditional Memory Enhanced Item Representation for Generative Recommendation

The paper introduces ComeIR, a Conditional Memory Enhanced Item Representation framework for generative recommendation. It reconstructs semantic identifier (SID) code embeddings into item-aware inputs, preserving structured SID relations through item-guided token scoring and dual-level conditional memory. The approach integrates these signals into historical item representations and conditions SID-level predictions on generated prefixes and transition evidence, showing improved performance in experiments.

arXiv Machine Learning
Aug 11

Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation

arXiv:2608. 07816v1 Announce Type: cross Abstract: Recent advances in generative recommendation (GR) leverage large language models (LLMs) as recommender backbones, enabling LLMs to directly generate recommendations conditioned on item-interaction histories.

By Donald Loveland, Liam Collins, Bhuvesh Kumar, Danai Koutra, Neil Shah
arXiv AI
5d ago

REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation

REGER is a unified framework that enhances generative recommendation by explicitly modeling inter-item relations through semantic pretraining, history encoding, and SID generation. It pretrains the model to generate semantic neighbors’ IDs, uses combined global and local attention to capture historical context, and introduces a hierarchical preference decomposition over the SID prefix tree. The approach also distills a discriminative teacher’s full conditional distributions to improve next-token predictions, yielding consistent performance gains on real-world datasets.

By Yuxi Huang, Silin Zhou, Chenhao Wang, Zihan Li, Gangming Guo, Pei Ke, Shen Gao, Shuo Shang
arXiv Computation and Language
5d ago

JevRec: Linguistic Encoding with Jev-like Decision Modeling for LLM-based Generative Recommendation

JevRec introduces a variable‑length linguistic encoding for items in generative recommendation, assigning shorter semantic identifiers (SIDs) to popular items and richer SIDs to long‑tail items. It separates length prediction and content generation into distinct heads while sharing the interaction‑history representation, mitigating gradient conflicts. Experiments on three public datasets demonstrate that JevRec surpasses baseline models in recommendation metrics and reduces training and inference time compared to TIGER.

By Qiyong Zhong, Jiajie Su, Ming Yang, Li Zhang
arXiv AI
Jun 8

Understanding Generative Recommendation with Semantic IDs from a Model-scaling View

arXiv:2509. 25522v3 Announce Type: replace Abstract: Recent advancements in generative models have allowed the emergence of a promising paradigm for recommender systems (RS), known as Generative Recommendation (GR), which tries to unify rich item semantics and collaborative filtering signals.

By Jingzhe Liu, Liam Collins, Jiliang Tang, Tong Zhao, Neil Shah, Clark Mingxuan Ju
Hugging Face Trending Papers
6d ago

REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation

REGER is a framework that enhances generative recommendation by explicitly modeling inter-item relations through semantic pretraining, refined history encoding, and SID generation. It pretrains the model to generate semantic neighbors’ IDs, uses a combination of global and local attention to capture context, and introduces a hierarchical preference decomposition that allows exact factorization of collaborative preferences. The method also distills a discriminative teacher’s full conditional distributions to improve next-token predictions, yielding consistent performance gains on real-world datasets.

arXiv Machine Learning
Aug 24

From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation

The paper proposes replacing a static multi‑level small semantic codebook with a dynamic single‑level large semantic codebook for generative recommendation. It introduces an exposure‑aware update mechanism and an offline evaluation framework, achieving significant improvements in recall, NDCG, decoding efficiency, and online consumption metrics on public datasets and production traffic.

By Tianlu Xie, Xin Ku, Mingjie Sun, Yunhao Sha, Lixiang Wang, Peng Wang, Yiyu Wang, Wenjin Wu, Zhaojie Liu, Peng Jiang, Wenwu Ou