A Systematic Study of Semantic ID Spaces for Generative Information Retrieval
Read the original on arXiv Computation and Language →The Flow has not summarised this story yet — read it at arXiv Computation and Language.
The Flow has not summarised this story yet — read it at arXiv Computation and Language.
ICICLE is an in‑context indexing framework that expands generative retrieval by supplying newly added documents as inference‑time evidence. It generates document identifiers using both parametric memory and context‑provided document‑docid pairs, employing a [COPY] routing mechanism, preference‑based calibration, and large‑context adaptation to separate context‑grounded retrieval from parametric retrieval. Experiments on MS MARCO and NQ320K demonstrate that ICICLE improves retrieval of new documents while retaining performance on previously indexed documents without retraining the model.
The paper introduces CHAP, a personalized generative retrieval framework that aligns query semantics with item representations through a hierarchical semantic alignment module and models user behavior using both discrete Semantic IDs and continuous representations. It also proposes a Residual Cascading Generation mechanism to reduce inference latency by limiting the Transformer decoder to a single pass. Experiments on multiple datasets and online A/B tests show that CHAP outperforms existing methods, demonstrating its practical value.
arXiv:2604. 19047v2 Announce Type: replace-cross Abstract: Existing QA benchmarks typically assume distinct documents with minimal overlap, yet real-world retrieval-augmented generation (RAG) systems operate on corpora such as financial reports, legal codes, and patents, where information is highly redundant and documents exhibit strong inter-document similarity.
arXiv:2602. 12187v2 Announce Type: replace-cross Abstract: Search-Augmented Generative Engines (SAGE) have emerged as a new paradigm for information access, bridging web-scale retrieval with generative capabilities to deliver synthesized answers.
arXiv:2610.13810v1 Announce Type: cross Abstract: Large language models (LLMs) are now a standard source of query expansion terms but they hallucinate. They inject non existent entities and off-topic...
arXiv:2606. 12451v1 Announce Type: new Abstract: Large language models deployed as agents over large tool catalogs face a critical tool-retrieval bottleneck.