Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,381 stories · RSS feed

arXiv Machine Learning
Sep 10

EigenLI: Spectral Approximations to Late Interaction

EigenLI introduces a spectral approximation framework that compresses late‑interaction representations by identifying document‑specific low‑dimensional subspaces. By selecting dominant eigendirections, it constructs reduced interaction representations that outperform clustering‑based pooling methods on ColBERTv2 and AnswerAI‑ColBERT‑small. The framework also yields EigenLI‑SV, a single‑vector ANN‑compatible representation that consistently surpasses comparable surrogates such as MUVERA across multiple datasets and text models.

By Archish S, Sabyasachi Basu, Ankit Garg, Ravishankar Krishnaswamy, Kirankumar Shiragur
arXiv AI
Sep 10

Better Later Than Sooner: Neuro-Symbolic Knowledge Graph Construction via Ontology-grounded Post-extraction Correction

The paper introduces a neuro‑symbolic framework for constructing knowledge graphs (KGs) that are grounded in an ontology. It combines open‑domain extraction, embedding‑based canonicalization of types and predicates, and a post‑extraction LLM‑based correction step to fix ontology violations, thereby reducing token usage and improving KG consistency. The resulting KGs support symbolic querying, as evidenced by the prevalence of SPARQL graph patterns in the extracted data.

By Lorenzo Loconte, Timothy Hospedales, Cristina Cornelio
arXiv AI
Sep 10

FastE: Readout-Triggered Token Compression for LLM Embedding Inference

FastE is a training‑free, plug‑and‑play method that compresses token prefixes in large language model (LLM) embedding inference. It uses a shared fixed threshold on batch‑mean readout‑prefix alignment to decide when to compress and ranks prefix states by readout attention scores to keep the most important ones. Experiments on Qwen3‑Embedding models show that FastE can cut decoder‑backbone FLOPs by over 40% while preserving more than 99% of the original ranking quality across multiple benchmarks and tasks.

By Jinsong Shu, Jinyong Wen, Baokun Wang, Zhongle Xie, Lidan Shou, Weiqiang Wang, Gang Chen
arXiv Machine Learning
Sep 10

HoneyRoute: Honeypot-Model Routing for Adversarial LLM Serving

HoneyRoute is an inference‑serving layer that identifies malicious requests and redirects them to a honeypot model, protecting the production model while collecting adversarial interactions for intelligence. It combines a lightweight streaming router, a dual‑implementation honeypot, and an analysis loop that turns captured interactions into attacker fingerprints for retraining. In evaluations on production traces and a seven‑domain attack corpus, HoneyRoute achieves high detection F1 scores with minimal latency overhead, significantly reduces token consumption during flooding attacks, and improves fidelity‑traceability trade‑offs compared to naive bait injection.

By Han Jin
Hugging Face Trending Papers
Sep 8

Q2D-Web: A Large-Scale Benchmark for Retrieval in Agentic RAG Systems

Q2D-Web is a new large‑scale benchmark for agentic Retrieval‑Augmented Generation (RAG) systems, featuring a 190 million‑document web corpus and 70 k machine‑reformulated search queries in ten languages. It supplies three sets of relevance judgments—agent citations, production rankings, and a combined set enriched with LLM‑based labels—to evaluate first‑stage retrievers. Experiments on 13 retrievers show consistent ranking across judgment sets but significant variation across domains, languages, and query types, and demonstrate that a carefully sampled sub‑corpus can approximate full‑corpus evaluation with minimal loss in Recall@1000.

Hugging Face Trending Papers
Sep 8

Beyond Gait: Person Identification from Millimeter-Wave Point Clouds Across Activities of Daily Living

The paper explores person identification using millimeter‑wave point clouds beyond traditional gait analysis, focusing on seven activities of daily living (ADLs). It introduces the mm‑ADL dataset of 11 subjects and proposes an activity‑conditioned framework that routes each clip to an activity‑specific identity expert via a supervised mixture of experts. Experiments show that hard routing improves closed‑set ID accuracy from 62.1% to 68.0% and significantly boosts re‑identification metrics, demonstrating the benefit of activity context under controlled indoor conditions.

Hugging Face Trending Papers
Sep 8

Layer Selection in VLMs for Zero-Shot OOD Detection via Multi-Resolution Entropy Estimation

The paper investigates zero‑shot out‑of‑distribution (OOD) detection in medical imaging using vision‑language models (VLMs). It shows that intermediate layers, rather than only the final layer, provide valuable OOD signals and that the best layer depends on the imaging modality. To overcome instability in entropy‑based layer selection, the authors introduce a multi‑resolution entropy estimation that aggregates histogram statistics across scales, achieving consistent improvements over state‑of‑the‑art methods on the MIDOG and OASIS benchmarks.

Hugging Face Trending Papers
Sep 8

ReMoMask-2: Latent Retrieval-Augmented Masked Motion Generation

ReMoMask-2 is a retrieval‑augmented text‑to‑motion generation framework that improves on complex motion descriptions by addressing coarse retrieval and representation gaps. It introduces a structure‑aware RAG pipeline with Hierarchical Bidirectional Momentum contrastive learning, Semantic Spatial‑Temporal Attention, and Topology Structured Masking, and rebuilds the retrieval database in the generator’s latent space using a lightweight projector. Experiments on HumanML3D, KIT‑ML, and SnapMoGen show state‑of‑the‑art retrieval accuracy and the lowest FID scores, with a single mask‑transformer stage delivering faster inference than the previous two‑stage design.

Hugging Face Trending Papers
Sep 8

HypLTSF: A Hyperbolic Geometric View of Multi-Scale Hierarchies for Long-Term Time Series Forecasting

HypLTSF introduces a hyperbolic geometric framework for long‑term time series forecasting by embedding multi‑scale representations into the Poincaré ball. The approach imposes radial and angular constraints to align the geometry with temporal hierarchies, ensuring that coarser scales abstract finer ones and that related fine‑scale patterns share common ancestors. Experiments on forecasting benchmarks demonstrate that this explicit geometric modeling of the hierarchy yields state‑of‑the‑art performance.