Off-Policy Evaluation for Semantic ID Recommenders: Does the Model's Own Code Hierarchy Help?
Read the original on arXiv Machine Learning →The Flow has not summarised this story yet — read it at arXiv Machine Learning.
The Flow has not summarised this story yet — read it at arXiv Machine Learning.
arXiv:2607. 24995v1 Announce Type: new Abstract: Semantic IDs (SIDs) are now a central component of generative recommendation.
arXiv:2609.22227v1 Announce Type: cross Abstract: Generative retrieval represents each item by a short Semantic ID and casts recommendation as autoregressive generation of that sequence. Because the...
arXiv:2509. 25522v3 Announce Type: replace Abstract: Recent advancements in generative models have allowed the emergence of a promising paradigm for recommender systems (RS), known as Generative Recommendation (GR), which tries to unify rich item semantics and collaborative filtering signals.
The paper proposes replacing a static multi‑level small semantic codebook with a dynamic single‑level large semantic codebook for generative recommendation. It introduces an exposure‑aware update mechanism and an offline evaluation framework, achieving significant improvements in recall, NDCG, decoding efficiency, and online consumption metrics on public datasets and production traffic.
SIDScope is a diagnostic tool that evaluates Semantic-ID mappings used between item tokenizers and generative recommenders. It normalizes artifacts, verifies provenance, profiles mapping structure, compares revisions, and tracks path-to-item outcomes in generated traces. Using data from Amazon and Yelp, SIDScope shows that interface health depends on multiple signals, revealing gaps in prefix alignment, trace accounting, and refresh handling that affect model reuse.
SIDScope is a diagnostic tool that evaluates Semantic‑ID interfaces used in generative recommendation systems. It normalizes item‑to‑code artifacts, verifies provenance, profiles mapping structure, and compares revisions while tracking path‑to‑item outcomes in generated traces. Using nine tokenizer exports from Amazon and Yelp data, SIDScope shows that interface health depends on multiple signals and reveals gaps in prefix alignment, trace accounting, and mapping refresh effects.