Retrieval-augmented generation

Retrieval pipelines, vector search, chunking and reranking: how models are grounded in a corpus instead of their weights.

6,126 stories · RSS feed

arXiv AI
Oct 2

TabJoinBench: A Benchmark for Joinable Table Discovery

TabJoinBench is a benchmark designed to evaluate join discovery methods across semantic, relational, and hybrid data lake scenarios. It constructs query‑candidate pairs using source‑specific validation strategies and introduces systematic perturbations—structural, representation, and semantic—while preserving reliable ground truth. The benchmark evaluates set‑based, feature‑based, learned, and language‑model embedding approaches, and publicly releases processed datasets, annotations, and a generation pipeline for reproducible research.

By Sandipan De, Jin Wang, Vivek Gupta
arXiv AI
Oct 2

JoinGR: Learning to Traverse Join Graphs for Table Retrieval

JoinGR is a join‑aware table retrieval method that treats a database’s join graph as the retrieval space. It represents columns as graph nodes and both intra‑table and foreign‑key relationships as typed edges, then selects anchor tables, traverses join edges with a query‑conditioned scorer, and aggregates edge deposits into table scores. Experiments on BIRD, Spider, and BEAVER show that JoinGR matches or surpasses strong retrieval baselines, especially improving recall on multi‑hop table requirements, and its learned scorer transfers across benchmarks, indicating reusable join‑graph traversal behavior.

By Sandipan De, Abhijit Chakraborty, Sambaran Bandyopadhyay, Vivek Gupta
arXiv AI
Oct 2

Cog-VADU: A Training-Free Cognitive Reasoning Framework for Video Anomaly Detection and Understanding

Cog-VADU is a training‑free framework that transforms video anomaly detection into a sequential cognitive reasoning task. It uses Chain‑of‑Anomaly Detection Thought Prompting (CoADTP) to create a recurrent reasoning chain across video segments, preserving temporal memory and distinguishing complex anomalies from high‑motion normal activities. A cross‑modal re‑ranking stage aligns textual rationales with visual embeddings to enforce semantic consistency and temporal coherence, yielding competitive zero‑shot performance on multiple VAD benchmarks.

By Mohd Ubaid Wani, Sara Atito, Josef Kittler, Muhammad Awais
arXiv Machine Learning
Oct 2

Gestalt: a meta-foundation model for astronomy

arXiv:2609.38312v1 Announce Type: cross Abstract: The Platonic Representation Hypothesis predicts that sufficiently scaled foundation models converge on a shared representation of the world. As each...

By Michael J. Smith, Shashwat Sourav
arXiv AI
Oct 2

Build2SPARQL: A Large-Scale Text-to-SPARQL Benchmark Dataset for Building Knowledge Graph Querying

Build2SPARQL is a large-scale benchmark dataset for translating natural-language questions into SPARQL queries over building knowledge graphs. The dataset is generated by a KG‑grounded pipeline that produces 6,136 executable SPARQL queries and 30,680 corresponding natural-language questions across six query-pattern families and five vocabulary registers, covering 201 building KGs. Human validation shows high semantic fidelity, naturalness, and operational plausibility, and retrieval‑augmented evaluation demonstrates significant accuracy gains for open‑weight language models.

By Wooyoung Jung
arXiv AI
Oct 2

NextMe-800: Anticipating Personal Behavior from Months of Egocentric Video

NextMe-800 is an approximately 800‑hour first‑person video dataset collected from a single volunteer over 126 days, featuring 1 Hz images, gaze, and audio. The data are captioned at five hierarchical abstraction levels—from atomic actions to major activities—enabling personalized action anticipation as an open‑vocabulary K‑step sequence prediction task. The authors also introduce NextAct, a 1,500‑point benchmark that combines NextMe‑800 with the multi‑person EgoLife dataset, and evaluate models using an embedding‑based soft edit distance to assess how well personal behavior can be anticipated across abstraction levels and prediction horizons.

By Zhaoxu Meng, Yiming Sun, Mingyuan Gao, Jiachang Zhang, Zhuhan Dai, Yipeng Du, Zheng Lian, Jian-Qiao Zhu
arXiv AI
Oct 2

ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research

ScholarCatalyst is a new benchmark that evaluates how well AI systems can retrieve research papers that inspire new work. The dataset was created by having 184 lead authors of 207 recent computer science papers annotate which earlier papers helped their projects, providing detailed rationales. The benchmark tests retrieval from the literature available at the start of a project, revealing that current agentic search and even advanced models like Claude Fable 5.1 perform only modestly better than simple embedding retrieval.

By Sohyeon Kim, Yoonho Lee, Bo Liu, Dayoon Ko, Rulin Shao, Seungone Kim, Graham Neubig, Pang Wei Koh, Aakanksha Chowdhery, Akari Asai, Omar Khattab, Yejin Choi, Gunhee Kim, Chelsea Finn