arXiv Machine Learning

Neighborhood-Aware Unlearning for Generative Recommendation

The paper introduces Neighborhood-Aware Unlearning (NAU) for generative recommendation systems that use semantic identifiers (SIDs). It addresses the problem that standard unlearning can unintentionally alter predictions for items neighboring the forgotten interactions due to shared SID tokens. NAU augments interaction-level unlearning with explicit control over probability mass in these neighborhoods, restoring utility for spam-induced exposures and recovering neighborhood performance without affecting overall test set metrics.

arXiv Machine Learning
Aug 11

Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation

arXiv:2608. 07816v1 Announce Type: cross Abstract: Recent advances in generative recommendation (GR) leverage large language models (LLMs) as recommender backbones, enabling LLMs to directly generate recommendations conditioned on item-interaction histories.

By Donald Loveland, Liam Collins, Bhuvesh Kumar, Danai Koutra, Neil Shah
arXiv AI
Oct 28

REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation

REGER is a unified framework that enhances generative recommendation by explicitly modeling inter-item relations through semantic pretraining, history encoding, and SID generation. It pretrains the model to generate semantic neighbors’ IDs, uses combined global and local attention to capture historical context, and introduces a hierarchical preference decomposition over the SID prefix tree. The approach also distills a discriminative teacher’s full conditional distributions to improve next-token predictions, yielding consistent performance gains on real-world datasets.

By Yuxi Huang, Silin Zhou, Chenhao Wang, Zihan Li, Gangming Guo, Pei Ke, Shen Gao, Shuo Shang
arXiv AI
Jun 9

TRACER: Token ReAssignment for Concept ERasure in Generative Recommendation

arXiv:2606. 07688v1 Announce Type: cross Abstract: Generative recommendation formulates next-item prediction as autoregressive generation over semantic ID (SID) sequences derived from users' historical interactions, making modern recommender systems structurally similar to large language models (LLMs).

By Ziheng Chen, Jiali Cheng, Zezhong Fan, Hadi Amiri, Diyuan Wu, Gabriele Tolomei, Yang Zhang
arXiv AI
Aug 12

FedCGR: Federated Cross-Domain Generative Recommendation

arXiv:2608. 10929v1 Announce Type: new Abstract: Cross-domain recommendation (CDR) transfers preference knowledge across related domains, but federated deployment makes cross-domain alignment difficult because the behavioral anchors that align item spaces, such as overlapping users and shared interaction signals, are often sparse, unavailable, or privacy-sensitive across clients.

By Zhuodong Liu, Hugen Lv, Xiangyu Li, Bohan Guo, Peiyu Hu
Hugging Face Trending Papers
Oct 27

REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation

REGER is a framework that enhances generative recommendation by explicitly modeling inter-item relations through semantic pretraining, refined history encoding, and SID generation. It pretrains the model to generate semantic neighbors’ IDs, uses a combination of global and local attention to capture context, and introduces a hierarchical preference decomposition that allows exact factorization of collaborative preferences. The method also distills a discriminative teacher’s full conditional distributions to improve next-token predictions, yielding consistent performance gains on real-world datasets.

arXiv AI
Aug 18

Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendation

arXiv:2608. 11980v2 Announce Type: replace-cross Abstract: Semantic-ID generative recommenders represent each item as a short sequence of discrete semantic tokens and predict the next item by autoregressively generating this token sequence.

By Kangning Zhang, Haotian Fang, Xukun Luo, Hao Yin, Yang Gao, Peng Yan, Weiwen Liu, Weinan Zhang, Yong Yu
arXiv AI
Oct 28

The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation

The paper introduces API, a framework that adapts pretrained interpretable features for generative recommendation. By reusing sparse autoencoder‑derived feature indices as a reusable semantic ID vocabulary, API avoids additional vocabulary learning and preserves item distinctions even with limited token budgets. The Semantic Prediction Adapter learns user preferences from interaction histories, combining feature‑index and strength predictions to score candidates, while also providing explainable retrieval through feature contributions linked to pretrained semantic annotations.

By Ziluowen Luo, Ruochen Liu, Jun Yin, Hao Yan, Zhengxuan Hu, Xinze Shi, Chaozhuo Li, Chengqi Zhang, Senzhang Wang
arXiv AI
Sep 25

Learning Better Reasoning for Generative Recommendation with Semantic IDs

The paper introduces Evo-Rec, a three‑stage framework that improves generative recommendation by learning better reasoning traces for Semantic ID (SID) generation. It first aligns SIDs with textual and behavioral contexts, then selects candidate reasoning traces that improve ground‑truth item prediction, and finally refines the reasoning policy via reinforcement learning with catalog‑constrained generation and ranking‑aware feedback. Experiments on Amazon Review datasets show Evo‑Rec consistently outperforms existing discriminative, generative, and reasoning‑enhanced recommenders across all metrics.

By Mengdan Zhu, Yufan Zhao, Sophie Di, Yao Zhao, Tao Di, Yulan Yan, Sridhar Iyer, Liang Zhao