Understanding Semantic IDs: From Item Representation to Item Selection in Generative Recommendation
arXiv:2607. 24995v1 Announce Type: new Abstract: Semantic IDs (SIDs) are now a central component of generative recommendation.
arXiv:2607. 24995v1 Announce Type: new Abstract: Semantic IDs (SIDs) are now a central component of generative recommendation.
arXiv:2609.22227v1 Announce Type: cross Abstract: Generative retrieval represents each item by a short Semantic ID and casts recommendation as autoregressive generation of that sequence. Because the...
arXiv:2509. 25522v3 Announce Type: replace Abstract: Recent advancements in generative models have allowed the emergence of a promising paradigm for recommender systems (RS), known as Generative Recommendation (GR), which tries to unify rich item semantics and collaborative filtering signals.
The paper proposes replacing a static multi‑level small semantic codebook with a dynamic single‑level large semantic codebook for generative recommendation. It introduces an exposure‑aware update mechanism and an offline evaluation framework, achieving significant improvements in recall, NDCG, decoding efficiency, and online consumption metrics on public datasets and production traffic.
SIDScope is a diagnostic tool that evaluates Semantic-ID mappings used between item tokenizers and generative recommenders. It normalizes artifacts, verifies provenance, profiles mapping structure, compares revisions, and tracks path-to-item outcomes in generated traces. Using data from Amazon and Yelp, SIDScope shows that interface health depends on multiple signals, revealing gaps in prefix alignment, trace accounting, and refresh handling that affect model reuse.
SIDScope is a diagnostic tool that evaluates Semantic‑ID interfaces used in generative recommendation systems. It normalizes item‑to‑code artifacts, verifies provenance, profiles mapping structure, and compares revisions while tracking path‑to‑item outcomes in generated traces. Using nine tokenizer exports from Amazon and Yelp data, SIDScope shows that interface health depends on multiple signals and reveals gaps in prefix alignment, trace accounting, and mapping refresh effects.
The paper proposes a retrieval‑grounded credit‑assignment method for generative recommenders that use Semantic IDs (SIDs). By structuring each generated trace into a history summary, a set of interest hypotheses, and a final SID, and then verifying each hypothesis with a frozen retriever, the method assigns reward at the hypothesis level rather than only at the final SID. Experiments on Amazon Reviews datasets show consistent improvements in SID recommendation, and an oracle analysis on Video Games data demonstrates that selecting target‑relevant queries among generated interests boosts recall and ranking.
arXiv:2607. 21101v1 Announce Type: new Abstract: Semantic-ID-based generative recommendation represents items as sequences of shared semantic tokens, enabling token recombination beyond isolated item IDs.
The paper introduces Difficulty‑Aware Semantic‑ID Optimization (DASO), a post‑training method for generative recommendation that improves tree‑structured item ranking. DASO profiles rollout groups by prefix‑match depth, reallocates a portion of candidates to prefix‑guided completions, and uses a SID‑prefix reward with an auxiliary SFT anchor to address target‑missing failures. On public benchmarks, DASO outperforms MiniOneRec‑style GRPO on 11 of 12 metrics and achieves the best results on 9 of 12 metrics, also improving level‑wise recall on an internal recommendation task.
EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendation proposes a method that adds explicit item-level competition into the denoising process of Semantic ID (SID) generative recommendation. The approach builds a personalized posterior over feasible candidate items based on the current generation context and the user's recent interactions, then projects this distribution back to unresolved SID positions to guide subsequent token decisions. Experiments on four Amazon benchmarks show consistent improvements over strong baselines, with diagnostic analyses indicating that the gains stem from personalized transition evidence that preserves promising item hypotheses during denoising.
The paper introduces a retrieval‑grounded credit‑assignment method for generative recommenders that use Semantic IDs (SIDs). By structuring each autoregressive trace into a history summary, a set of interest hypotheses, and a final SID, a frozen retriever verifies each hypothesis as a catalog query. Rewards are assigned at the hypothesis level when any query retrieves the target within the top‑K, allowing distinct updates for rollouts that share the same SID reward and improving SID recommendation performance on Amazon Reviews datasets.
arXiv:2605. 17648v2 Announce Type: replace Abstract: Generative recommendation treats next-item prediction as autoregressive item-identifier generation.