← Back to all news
arXiv AI By Ziluowen Luo, Ruochen Liu, Jun Yin, Hao Yan, Zhengxuan Hu, Xinze Shi, Chaozhuo Li, Chengqi Zhang, Senzhang Wang

The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation

Read the original on arXiv AI →

The paper introduces API, a framework that adapts pretrained interpretable features for generative recommendation. By reusing sparse autoencoder‑derived feature indices as a reusable semantic ID vocabulary, API avoids additional vocabulary learning and preserves item distinctions even with limited token budgets. The Semantic Prediction Adapter learns user preferences from interaction histories, combining feature‑index and strength predictions to score candidates, while also providing explainable retrieval through feature contributions linked to pretrained semantic annotations.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv AI.

Related stories

arXiv AI
5d ago

REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation

REGER is a unified framework that enhances generative recommendation by explicitly modeling inter-item relations through semantic pretraining, history encoding, and SID generation. It pretrains the model to generate semantic neighbors’ IDs, uses combined global and local attention to capture historical context, and introduces a hierarchical preference decomposition over the SID prefix tree. The approach also distills a discriminative teacher’s full conditional distributions to improve next-token predictions, yielding consistent performance gains on real-world datasets.

By Yuxi Huang, Silin Zhou, Chenhao Wang, Zihan Li, Gangming Guo, Pei Ke, Shen Gao, Shuo Shang
ragefficiency
More like this →
arXiv Machine Learning
Aug 11

Preserving Item Semantics for Free: Rethinking Token Initialization in LLM-Based Generative Recommendation

arXiv:2608. 07816v1 Announce Type: cross Abstract: Recent advances in generative recommendation (GR) leverage large language models (LLMs) as recommender backbones, enabling LLMs to directly generate recommendations conditioned on item-interaction histories.

By Donald Loveland, Liam Collins, Bhuvesh Kumar, Danai Koutra, Neil Shah
llmsragfine-tuning
More like this →
arXiv AI
Aug 18

Learning from Unreachable Rewards: Hint-Conditioned Reinforcement Learning for Generative Recommendation

arXiv:2608. 11980v2 Announce Type: replace-cross Abstract: Semantic-ID generative recommenders represent each item as a short sequence of discrete semantic tokens and predict the next item by autoregressively generating this token sequence.

By Kangning Zhang, Haotian Fang, Xukun Luo, Hao Yin, Yang Gao, Peng Yan, Weiwen Liu, Weinan Zhang, Yong Yu
reinforcement-learningfine-tuningbenchmarkssafety
More like this →