arXiv AI

SemJoin: Semantic Join Optimization

arXiv:2606. 29532v1 Announce Type: cross Abstract: Integrating unstructured data into relational database systems is increasingly important as demand grows for natural language querying and analysis.

arXiv AI
Sep 18

Efficiently Linking Unstructured Data for Multi-step Reasoning

The paper introduces DASE, a query engine designed to efficiently link unstructured data for multi-step reasoning tasks. DASE combines a multi-step reasoning model, a sparse materialized embedding-similarity join index (SemJI), and a co‑designed execution layer to perform multi‑attribute filtering, multi‑vector search, exact relational joins, and thresholded embedding‑similarity joins. In scientific discovery workloads, DASE outperforms traditional RDBMS, rerank, and vector‑database baselines by 6x to 46x in retrieval speed while maintaining comparable recall, and it serves as a high‑recall prefilter that reduces downstream LLM evaluation cost and improves accuracy on benchmarks such as SemBench E‑Commerce.

By Jiaming Liang, Haydn Jones, Jacob R. Gardner, Mark Yatskar, Zachary Ives
arXiv AI
Aug 24

SAGE: A Unified Algebra and Self-Adaptive Execution for AI Functions in SQL

SAGE (Self-Adaptive Generative Execution) introduces a unified framework for integrating AI functions into SQL by defining three typed primitives—AI_SCALAR, AI_AGG, and AI_JOIN—that correspond to the relational roles of transforming rows, aggregating groups, and joining row pairs. The framework standardizes a confidence-gated execution interface and tailors physical strategies to each primitive’s shape, with AI_JOIN employing predicate analysis and a recipe card to select optimal execution plans. Evaluations across scalar, aggregate, and join workloads demonstrate that SAGE consistently improves execution quality and efficiency, achieving the best overall SemBench performance and dramatically reducing model calls in factorable joins.

By Xiangqi Wang, Nhan H. Pham, Oktie Hassanzadeh, Dharmashankar Subramanian, Xiangliang Zhang