arXiv AI

Training a Knowledge Base: Supervised Structure Learning for Agent-Curated Document Stores

arXiv AI
Aug 19

DEPT: Document Embedding Preservation Tuning for Unified Query Expansion and Retrieval

The paper introduces DEPT, a method that trains a single decoder-only large language model to both expand queries and encode documents for retrieval. By preserving document embeddings close to their initial cached values while allowing gradients to flow through the generator, DEPT stabilizes retrieval targets and enables efficient index reuse and online hard‑negative mining. Experiments on the BEIR benchmark with Qwen3‑4B‑Instruct‑2507 and LLaMA‑3.2‑3B‑Instruct show that DEPT outperforms training‑free, independently trained, and staged unified baselines, with ablations confirming the benefits of preservation, whitening, end‑to‑end expansion training, and online negatives.

By Jingyuan Wang, Richong Zhang, Zhijie Nie, Mingxin Li, Yanzhao Zhang
arXiv AI
2d ago

From Association to Causation: Improving Retrieval Precision of Retrieval-Augmented Generation via Causal Relations and an Attention Mechanism

arXiv:2608.21702v1 Announce Type: new Abstract: Retrieval-Augmented Generation (RAG) grounds LLM generation on retrieved documents, but the standard terminal retrieval stage--dense-vector similarity,...

By Jing Liu, Yongxing Qi, Muchen Jiang, Chengnan Hu, Qingqing Peng, Haoming Wang, Yuqing Wang, Yang Yu, Xu Zhang, Ting Wu
arXiv AI
1d ago

Evidence Blindness in Direct Corpus Interaction: Persistent Navigation with AtlasNav

The paper introduces AtlasNav, a persistent multi‑view corpus‑navigation framework that organizes a corpus into a Corpus Atlas, enabling large‑language‑model agents to navigate efficiently under finite interaction budgets. AtlasNav reduces online inference cost by 30.21% and achieves 92.05% strict accuracy on BrowseComp‑Plus, while earlier and more rapidly realizing required evidence compared to dynamic‑workspace methods. The approach also transfers well to other corpora such as PhantomWiki and heterogeneous enterprise knowledge bases, demonstrating that effective agentic search relies on both accessible evidence and a reusable corpus representation.

By Hongyu Guo, Zhiyu Zheng, Zhao Cao
arXiv Computation and Language
3d ago

Index SLM Technical Report

arXiv:2607.09885v3 Announce Type: replace Abstract: We present Index-1.9B, a series of open small language models developed at Bilibili. The series comprises four models: Index-1.9B-Base, a foundatio...

By Tianjiao Li, Lusheng Zhang, Shien He, Xiaojing Liu, Tianxing Yan, Mengran Yu, Ziang Cui, Kai Zhao, Xipeng Wang, Yang Liu, Yuxin Li
Hugging Face Trending Papers
Aug 17

LENS: In-Context Search via Latent Evidence Exploration over Dynamic Raw Documents

LLM agents increasingly answer questions over dynamic raw-document collections, where files may change before preprocessing, and relevant evidence (spans, sections, pages, or tables) is query-dependent. Existing retrieval-augmented approaches pre-materialize evidence via fixed chunking, embeddings, or persistent indexes: effective for lookup, yet costly, stale-prone, and committed to a granularity before the query is known.